2024-09-14T20:58:58.276 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T20:58:58.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T20:58:58.388 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598 branch: main description: krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{legacy} tasks/compare-mirror-images} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904598' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false machine_type: smithi meta: - desc: 2 ceph clusters with 1 mon, 1 mgr and 3 osd each name: teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: rbd default map options: ms_mode=legacy global: mon warn on pool no app: false ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 extra_system_packages: - pv thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - cluster1.mon.a - cluster1.mgr.x - cluster1.osd.0 - cluster1.osd.1 - cluster1.osd.2 - - cluster2.mon.a - cluster2.mgr.x - cluster2.osd.0 - cluster2.osd.1 - cluster2.osd.2 - cluster1.client.mirror - cluster1.client.mirror.0 - cluster2.client.mirror - cluster2.client.mirror.0 seed: 8145 sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 sleep_before_teardown: 0 subset: 0/4 suite: krbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_711c10c3b606220cc536e8cfed3eb9d03ecd33d1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdDtSlVWGp9Vj2qzHuL58OVrpq3fzHe/2RVQK/fgVZn64i26CHL6650A+11TNPKW+2jiNWTo2aKDSlc9AkB49w= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3JpJXPmEtDM2SWMCJoeLVs37Pm9b51micdFDljVDo8cuFytRuis/x7K/cICcGqkvDBu+5JC8TJ84OMczgdnhM= tasks: - install: extra_packages: - rbd-mirror - ceph: cluster: cluster1 - ceph: cluster: cluster2 - rbd-mirror: client: cluster1.client.mirror.0 thrash: false - rbd-mirror: client: cluster2.client.mirror.0 thrash: false - workunit: clients: cluster1.client.mirror: - rbd/compare_mirror_images.sh env: RBD_DEVICE_TYPE: krbd RBD_MIRROR_USE_RBD_MIRROR: '1' timeout: 3h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-14_20:48:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T20:58:58.388 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_711c10c3b606220cc536e8cfed3eb9d03ecd33d1/qa; will attempt to use it 2024-09-14T20:58:58.388 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_711c10c3b606220cc536e8cfed3eb9d03ecd33d1/qa/tasks 2024-09-14T20:58:58.389 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T20:58:58.390 INFO:teuthology.task.internal:Checking packages... 2024-09-14T20:58:58.410 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '711c10c3b606220cc536e8cfed3eb9d03ecd33d1' 2024-09-14T20:58:58.410 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T20:58:58.411 INFO:teuthology.packaging:ref: None 2024-09-14T20:58:58.411 INFO:teuthology.packaging:tag: None 2024-09-14T20:58:58.411 INFO:teuthology.packaging:branch: main 2024-09-14T20:58:58.411 INFO:teuthology.packaging:sha1: 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T20:58:58.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T20:58:58.619 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4928.g711c10c3 2024-09-14T20:58:58.620 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T20:58:58.626 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T20:58:58.627 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T20:58:58.635 INFO:teuthology.task.internal:Saving configuration 2024-09-14T20:58:58.646 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T20:58:58.653 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T20:58:58.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 20:50:51.351388', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdDtSlVWGp9Vj2qzHuL58OVrpq3fzHe/2RVQK/fgVZn64i26CHL6650A+11TNPKW+2jiNWTo2aKDSlc9AkB49w='} 2024-09-14T20:58:58.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 20:50:51.352862', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3JpJXPmEtDM2SWMCJoeLVs37Pm9b51micdFDljVDo8cuFytRuis/x7K/cICcGqkvDBu+5JC8TJ84OMczgdnhM='} 2024-09-14T20:58:58.705 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T20:58:58.711 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2'] 2024-09-14T20:58:58.711 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.mgr.x', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster2.client.mirror', 'cluster2.client.mirror.0'] 2024-09-14T20:58:58.711 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T20:58:58.768 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f871e487ac0>, signals=[15]) 2024-09-14T20:58:58.768 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T20:58:58.774 INFO:teuthology.task.internal:Opening connections... 2024-09-14T20:58:58.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T20:58:58.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T20:58:58.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T20:58:58.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T20:58:58.926 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T20:58:58.932 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-14T20:58:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-14T20:58:58.951 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-14T20:58:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T20:58:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T20:58:59.010 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-14T20:58:59.039 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-14T20:58:59.057 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-14T20:58:59.058 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-14T20:58:59.115 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T20:58:59.116 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T20:58:59.116 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-14T20:58:59.139 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T20:58:59.147 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T20:58:59.152 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T20:58:59.153 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-14T20:58:59.155 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-14T20:58:59.171 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T20:58:59.177 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T20:58:59.177 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-14T20:58:59.213 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-14T20:58:59.329 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T20:58:59.384 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T20:58:59.398 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-14T20:58:59.398 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'cluster2.mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-14T20:58:59.399 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T20:58:59.399 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T20:58:59.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T20:58:59.416 DEBUG:teuthology.task.kernel:sha1 for cluster2.mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.416 INFO:teuthology.task.kernel:Checking kernel version of cluster2.mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-14T20:58:59.416 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-14T20:58:59.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T20:58:59.417 DEBUG:teuthology.task.kernel:sha1 for cluster1.mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.417 INFO:teuthology.task.kernel:Checking kernel version of cluster1.mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-14T20:58:59.418 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-14T20:58:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-503.el9.x86_64 2024-09-14T20:58:59.474 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.475 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-14T20:58:59.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.479 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-14T20:58:59.479 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.479 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-14T20:58:59.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:58:59.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum upgrade -y linux-firmware 2024-09-14T20:58:59.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum upgrade -y linux-firmware 2024-09-14T20:59:01.835 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-14T20:59:01.855 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-14T20:59:03.694 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-14T20:59:05.780 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 20 MB 00:02 2024-09-14T20:59:08.795 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-14T20:59:10.562 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-14T20:59:11.181 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-14T20:59:11.483 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-14T20:59:12.708 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-14T20:59:13.527 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-14T20:59:16.972 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T20:59:19.091 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-14T20:59:19.093 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-09-14T20:59:19.093 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-14T20:59:19.195 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on cluster2.mon.a... 2024-09-14T20:59:19.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:59:19.217 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T20:59:19.340 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-14T20:59:19.341 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-14T20:59:19.343 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi169.front.sepia.ceph.com to complete... 2024-09-14T20:59:21.412 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-14T20:59:21.413 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-14T20:59:21.413 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-14T20:59:21.511 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on cluster1.mon.a... 2024-09-14T20:59:21.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-14T20:59:21.654 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-14T20:59:21.655 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-14T20:59:21.657 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-09-14T21:09:34.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14 21:09:34 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-14T21:09:34.962 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2024-09-14 21:09:34-- 2024-09-14T21:09:34.962 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 10m 13s 2024-09-14T21:09:34.962 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 343M in 10m 13s (573 KB/s) 2024-09-14T21:09:34.965 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on cluster1.mon.a... 2024-09-14T21:09:34.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-14T21:09:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying... ######################################## 2024-09-14T21:09:37.301 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing... ######################################## 2024-09-14T21:09:37.411 INFO:teuthology.orchestra.run.smithi063.stdout:Updating / installing... 2024-09-14T21:09:45.711 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-14T21:10:13.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14 21:10:13 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-14T21:10:13.502 INFO:teuthology.orchestra.run.smithi169.stderr:FINISHED --2024-09-14 21:10:13-- 2024-09-14T21:10:13.502 INFO:teuthology.orchestra.run.smithi169.stderr:Total wall clock time: 10m 54s 2024-09-14T21:10:13.502 INFO:teuthology.orchestra.run.smithi169.stderr:Downloaded: 1 files, 343M in 10m 54s (537 KB/s) 2024-09-14T21:10:13.505 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on cluster2.mon.a... 2024-09-14T21:10:13.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-14T21:10:15.656 INFO:teuthology.orchestra.run.smithi169.stdout:Verifying... ######################################## 2024-09-14T21:10:15.821 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing... ######################################## 2024-09-14T21:10:15.923 INFO:teuthology.orchestra.run.smithi169.stdout:Updating / installing... 2024-09-14T21:10:22.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-14T21:10:22.995 DEBUG:teuthology.orchestra.run.smithi063:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-14T21:10:23.079 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-14T21:10:23.080 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-14T21:10:23.081 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-14T21:10:23.082 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-14T21:10:23.083 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-14T21:10:23.084 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-14T21:10:23.085 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-14T21:10:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-14T21:10:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-14T21:10:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-14T21:10:23.089 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-14T21:10:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-14T21:10:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-14T21:10:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-14T21:10:23.093 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-14T21:10:23.094 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-14T21:10:23.095 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-14T21:10:23.096 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-14T21:10:23.097 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-14T21:10:23.098 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-14T21:10:23.099 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-14T21:10:23.100 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-14T21:10:23.101 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-14T21:10:23.102 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-14T21:10:23.103 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-14T21:10:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-14T21:10:23.105 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-14T21:10:23.106 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-14T21:10:23.107 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-14T21:10:23.108 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-14T21:10:23.109 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-14T21:10:23.110 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-14T21:10:23.111 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-14T21:10:23.112 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-14T21:10:23.113 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-14T21:10:23.114 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-14T21:10:23.115 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-14T21:10:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-14T21:10:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-14T21:10:23.118 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-14T21:10:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-14T21:10:23.120 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-14T21:10:23.121 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-14T21:10:23.122 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-14T21:10:23.123 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-14T21:10:23.124 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-14T21:10:23.125 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-14T21:10:23.126 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-14T21:10:23.127 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-14T21:10:23.128 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-14T21:10:23.129 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-14T21:10:23.130 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-14T21:10:23.131 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-14T21:10:23.132 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-14T21:10:23.133 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-14T21:10:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-14T21:10:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-14T21:10:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-14T21:10:23.137 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-14T21:10:23.138 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-14T21:10:23.139 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-14T21:10:23.139 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-14T21:10:23.140 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-14T21:10:23.141 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-14T21:10:23.142 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-14T21:10:23.143 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-14T21:10:23.144 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-14T21:10:23.145 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-14T21:10:23.146 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-14T21:10:23.147 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-14T21:10:23.148 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-14T21:10:23.149 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-14T21:10:23.150 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-14T21:10:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-14T21:10:23.152 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-14T21:10:23.153 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-14T21:10:23.154 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-14T21:10:23.155 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-14T21:10:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-14T21:10:23.157 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-14T21:10:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-14T21:10:23.159 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-14T21:10:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-14T21:10:23.161 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-14T21:10:23.162 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-14T21:10:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-14T21:10:23.164 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-14T21:10:23.165 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-14T21:10:23.166 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-14T21:10:23.167 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-14T21:10:23.168 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-14T21:10:23.169 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-14T21:10:23.170 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-14T21:10:23.171 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-14T21:10:23.172 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-14T21:10:23.173 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-14T21:10:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-14T21:10:23.175 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-14T21:10:23.176 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-14T21:10:23.177 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-14T21:10:23.178 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-14T21:10:23.179 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-14T21:10:23.180 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-14T21:10:23.181 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-14T21:10:23.182 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-14T21:10:23.183 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-14T21:10:23.184 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-14T21:10:23.185 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-14T21:10:23.186 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-14T21:10:23.187 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-14T21:10:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-14T21:10:23.189 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-14T21:10:23.190 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-14T21:10:23.191 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-14T21:10:23.192 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-14T21:10:23.193 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-14T21:10:23.194 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-14T21:10:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-14T21:10:23.196 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-14T21:10:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-14T21:10:23.198 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-14T21:10:23.199 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-14T21:10:23.200 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-14T21:10:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-14T21:10:23.202 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-14T21:10:23.203 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-14T21:10:23.204 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-14T21:10:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-14T21:10:23.206 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-14T21:10:23.207 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-14T21:10:23.208 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-14T21:10:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-14T21:10:23.210 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-14T21:10:23.211 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-14T21:10:23.212 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-14T21:10:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-14T21:10:23.214 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-14T21:10:23.215 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-14T21:10:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-14T21:10:23.217 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-14T21:10:23.218 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-14T21:10:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-14T21:10:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-14T21:10:23.221 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-14T21:10:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-14T21:10:23.223 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-14T21:10:23.224 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-14T21:10:23.225 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-14T21:10:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-14T21:10:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-14T21:10:23.231 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.231 DEBUG:teuthology.orchestra.run.smithi063:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-14T21:10:23.254 INFO:teuthology.orchestra.run.smithi063.stdout:postinstall scriptlet (using /bin/sh): 2024-09-14T21:10:23.254 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-14T21:10:23.254 INFO:teuthology.orchestra.run.smithi063.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-14T21:10:23.254 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:for file in vmlinuz System.map config; do 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: fi 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:done 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-14T21:10:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-14T21:10:23.256 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.256 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2024-09-14T21:10:23.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-14T21:10:23.329 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:10:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T21:10:23.331 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T21:10:23.331 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:23.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T21:10:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-14T21:10:23.949 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-14T21:10:25.291 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T21:10:25.318 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-14T21:10:25.321 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-14T21:10:25.335 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.8CzKMH4GPJ 2024-09-14T21:10:25.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8CzKMH4GPJ 2024-09-14T21:10:25.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.8CzKMH4GPJ 2024-09-14T21:10:25.544 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.8CzKMH4GPJ is 6KB 2024-09-14T21:10:25.593 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.8CzKMH4GPJ 2024-09-14T21:10:25.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T21:10:25.678 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T21:10:25.679 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T21:10:25.679 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T21:10:25.679 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-14T21:10:25.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:10:25.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-14T21:10:55.824 INFO:teuthology.task.kernel:Checking client cluster1.mon.a for new kernel version... 2024-09-14T21:10:55.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:10:55.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:11:01.815 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-14T21:11:01.816 DEBUG:teuthology.orchestra.run.smithi169:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-14T21:11:01.904 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:01.904 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:01.904 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:01.904 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-14T21:11:01.905 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-14T21:11:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-14T21:11:01.907 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-14T21:11:01.908 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-14T21:11:01.909 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-14T21:11:01.910 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-14T21:11:01.911 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-14T21:11:01.912 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-14T21:11:01.913 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-14T21:11:01.914 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-14T21:11:01.915 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-14T21:11:01.916 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-14T21:11:01.917 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-14T21:11:01.918 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-14T21:11:01.919 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-14T21:11:01.920 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-14T21:11:01.921 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-14T21:11:01.922 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-14T21:11:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-14T21:11:01.924 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-14T21:11:01.925 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-14T21:11:01.926 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-14T21:11:01.927 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-14T21:11:01.928 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-14T21:11:01.929 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-14T21:11:01.930 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-14T21:11:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-14T21:11:01.932 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-14T21:11:01.933 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-14T21:11:01.934 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-14T21:11:01.935 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-14T21:11:01.936 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-14T21:11:01.937 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-14T21:11:01.938 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-14T21:11:01.939 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-14T21:11:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-14T21:11:01.941 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-14T21:11:01.942 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-14T21:11:01.943 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-14T21:11:01.944 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-14T21:11:01.945 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-14T21:11:01.946 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-14T21:11:01.947 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-14T21:11:01.948 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-14T21:11:01.949 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-14T21:11:01.950 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-14T21:11:01.951 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-14T21:11:01.952 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-14T21:11:01.953 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-14T21:11:01.954 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-14T21:11:01.955 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-14T21:11:01.956 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-14T21:11:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-14T21:11:01.958 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-14T21:11:01.959 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-14T21:11:01.960 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-14T21:11:01.961 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-14T21:11:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-14T21:11:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-14T21:11:01.964 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-14T21:11:01.965 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-14T21:11:01.966 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-14T21:11:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-14T21:11:01.968 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-14T21:11:01.969 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-14T21:11:01.970 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-14T21:11:01.971 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-14T21:11:01.972 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-14T21:11:01.973 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-14T21:11:01.974 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-14T21:11:01.975 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-14T21:11:01.976 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-14T21:11:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-14T21:11:01.978 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-14T21:11:01.979 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-14T21:11:01.980 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-14T21:11:01.981 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-14T21:11:01.982 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-14T21:11:01.983 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-14T21:11:01.984 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-14T21:11:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-14T21:11:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-14T21:11:01.987 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-14T21:11:01.988 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-14T21:11:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-14T21:11:01.990 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-14T21:11:01.991 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-14T21:11:01.992 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-14T21:11:01.993 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-14T21:11:01.994 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-14T21:11:01.995 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-14T21:11:01.996 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-14T21:11:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-14T21:11:01.998 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-14T21:11:01.999 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-14T21:11:02.000 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-14T21:11:02.001 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-14T21:11:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-14T21:11:02.003 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-14T21:11:02.004 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-14T21:11:02.005 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-14T21:11:02.006 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-14T21:11:02.007 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-14T21:11:02.008 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-14T21:11:02.009 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-14T21:11:02.010 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-14T21:11:02.011 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-14T21:11:02.012 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-14T21:11:02.013 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-14T21:11:02.014 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-14T21:11:02.015 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-14T21:11:02.016 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-14T21:11:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-14T21:11:02.018 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-14T21:11:02.019 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-14T21:11:02.020 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-14T21:11:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-14T21:11:02.022 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-14T21:11:02.023 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-14T21:11:02.024 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-14T21:11:02.025 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-14T21:11:02.026 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-14T21:11:02.027 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-14T21:11:02.028 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-14T21:11:02.029 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-14T21:11:02.030 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-14T21:11:02.031 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-14T21:11:02.032 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-14T21:11:02.033 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-14T21:11:02.034 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-14T21:11:02.036 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-14T21:11:02.037 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-14T21:11:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-14T21:11:02.039 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-14T21:11:02.040 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-14T21:11:02.041 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-14T21:11:02.042 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-14T21:11:02.043 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-14T21:11:02.044 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-14T21:11:02.045 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-14T21:11:02.046 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-14T21:11:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-14T21:11:02.048 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-14T21:11:02.049 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-14T21:11:02.050 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-14T21:11:02.051 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-14T21:11:02.052 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-14T21:11:02.053 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-14T21:11:02.056 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:02.057 DEBUG:teuthology.orchestra.run.smithi169:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-14T21:11:02.079 INFO:teuthology.orchestra.run.smithi169.stdout:postinstall scriptlet (using /bin/sh): 2024-09-14T21:11:02.079 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-14T21:11:02.079 INFO:teuthology.orchestra.run.smithi169.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:for file in vmlinuz System.map config; do 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: fi 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-14T21:11:02.080 INFO:teuthology.orchestra.run.smithi169.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-09-14T21:11:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-14T21:11:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-14T21:11:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-09-14T21:11:02.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2024-09-14T21:11:02.154 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.06 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 82.el9 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Group : Unspecified 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 8274670 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T21:11:02.155 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : builder@centos.org 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T21:11:02.156 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2024-09-14T21:11:02.157 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:11:02.157 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T21:11:02.157 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T21:11:02.158 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:02.158 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T21:11:02.779 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-09-14T21:11:04.122 INFO:teuthology.orchestra.run.smithi169.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T21:11:04.153 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-09-14T21:11:04.156 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-14T21:11:04.171 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.ttOeFF3F05 2024-09-14T21:11:04.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ttOeFF3F05 2024-09-14T21:11:04.238 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.ttOeFF3F05 2024-09-14T21:11:04.383 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.ttOeFF3F05 is 6KB 2024-09-14T21:11:04.431 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.ttOeFF3F05 2024-09-14T21:11:04.447 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T21:11:04.511 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T21:11:04.511 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T21:11:04.511 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T21:11:04.511 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-14T21:11:04.512 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:11:04.658 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-09-14T21:11:14.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-14T21:11:23.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:11:23.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:11:26.301 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-14T21:11:34.668 INFO:teuthology.task.kernel:Checking client cluster2.mon.a for new kernel version... 2024-09-14T21:11:34.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:11:34.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:11:38.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:11:38.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:11:53.153 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-14T21:11:56.737 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-14T21:12:02.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:12:02.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:12:05.217 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-14T21:12:11.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:12:11.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:12:12.136 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-14T21:12:12.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:12:12.752 INFO:teuthology.task.kernel:Checking kernel version of cluster1.mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-14T21:12:12.752 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-14T21:12:12.787 INFO:teuthology.orchestra.run.smithi063.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:12:12.787 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:12:12.787 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T21:12:12.787 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T21:12:13.788 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a... 2024-09-14T21:12:13.788 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T21:12:13.918 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-09-14T21:12:13.943 DEBUG:teuthology.parallel:result is None 2024-09-14T21:12:17.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:12:17.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:13:17.221 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T21:13:32.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:13:32.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:13:32.714 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-14T21:13:33.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:13:33.181 INFO:teuthology.task.kernel:Checking kernel version of cluster2.mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-14T21:13:33.181 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-14T21:13:33.215 INFO:teuthology.orchestra.run.smithi169.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:13:33.216 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-14T21:13:33.216 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T21:13:33.216 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T21:13:34.219 INFO:teuthology.task.kernel:Enabling kdb on cluster2.mon.a... 2024-09-14T21:13:34.219 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T21:13:34.331 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-09-14T21:13:34.364 DEBUG:teuthology.parallel:result is None 2024-09-14T21:13:34.364 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T21:13:34.383 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T21:13:34.384 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T21:13:34.389 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T21:13:34.432 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T21:13:34.441 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T21:13:34.456 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T21:13:34.457 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T21:13:34.478 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T21:13:34.564 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T21:13:34.592 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T21:13:34.592 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T21:13:34.599 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T21:13:34.663 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T21:13:34.665 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T21:13:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T21:13:34.689 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T21:13:34.692 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T21:13:34.701 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T21:13:34.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T21:13:34.705 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T21:13:34.762 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T21:13:34.775 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T21:13:34.776 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T21:13:34.780 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T21:13:34.815 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T21:13:34.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T21:13:35.032 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T21:13:35.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T21:13:35.165 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:13:35.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T21:13:35.219 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T21:13:35.285 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T21:13:35.379 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T21:13:35.443 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T21:13:35.515 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:13:35.515 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T21:13:35.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-14T21:13:35.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-14T21:13:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T21:13:35.688 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T21:13:36.049 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T21:13:36.057 INFO:teuthology.task.internal:Starting timer... 2024-09-14T21:13:36.057 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T21:13:36.069 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T21:13:36.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-14T21:13:36.184 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-14T21:13:36.187 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-14T21:13:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-14T21:13:36.285 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T21:13:36.286 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-14T21:13:36.330 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-14T21:13:36.330 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-14T21:13:36.370 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-14T21:13:36.370 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-14T21:13:36.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T21:13:36.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T21:13:36.429 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T21:13:36.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T21:13:36.486 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T21:13:36.486 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-14T21:13:36.552 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-14T21:13:36.620 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T21:13:36.628 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T21:13:36.642 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T21:13:36.643 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T21:19:01.886 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-14T21:19:01.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:19:01.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:19:01.981 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-14T21:19:02.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-14T21:19:02.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:19:02.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T21:19:02.174 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-14T21:19:02.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-14T21:19:02.287 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T21:19:02.300 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T21:19:02.300 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T21:19:02.301 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T21:19:02.305 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T21:19:02.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T21:19:02.362 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T21:19:02.388 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T21:19:02.391 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T21:19:02.417 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T21:19:02.443 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-14T21:19:02.467 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-14T21:19:02.468 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-14T21:19:02.493 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-14T21:19:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T21:19:02.522 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T21:19:02.525 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T21:19:02.553 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T21:19:02.623 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-14T21:19:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T21:19:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-14T21:19:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.662 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.669 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T21:19:02.670 INFO:teuthology.run_tasks:Running task install... 2024-09-14T21:19:02.680 DEBUG:teuthology.task.install:project ceph 2024-09-14T21:19:02.680 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}, 'extra_system_packages': ['pv']} 2024-09-14T21:19:02.680 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'extra_system_packages': ['pv']} 2024-09-14T21:19:02.681 INFO:teuthology.task.install:Using flavor: default 2024-09-14T21:19:02.686 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T21:19:02.686 INFO:teuthology.task.install:extra packages: ['rbd-mirror'] 2024-09-14T21:19:02.687 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': ['pv'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'tag': None, 'wait_for_package': False} 2024-09-14T21:19:02.687 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:19:02.689 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': ['pv'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'tag': None, 'wait_for_package': False} 2024-09-14T21:19:02.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:19:02.829 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/ 2024-09-14T21:19:02.830 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4928.g711c10c3 2024-09-14T21:19:02.843 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/ 2024-09-14T21:19:02.843 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4928.g711c10c3 2024-09-14T21:19:03.157 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T21:19:03.157 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:19:03.157 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T21:19:03.165 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T21:19:03.165 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:19:03.165 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T21:19:03.215 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror, pv, pv, pv on remote rpm x86_64 2024-09-14T21:19:03.215 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T21:19:03.225 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror, pv, pv, pv, pv on remote rpm x86_64 2024-09-14T21:19:03.225 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/711c10c3b606220cc536e8cfed3eb9d03ecd33d1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T21:19:03.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T21:19:03.322 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T21:19:03.392 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T21:19:03.401 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T21:19:03.447 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-14T21:19:03.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-14T21:19:03.456 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-14T21:19:03.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-14T21:19:03.732 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-14T21:19:03.745 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-14T21:19:03.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd rbd-mirror pv pv pv pv 2024-09-14T21:19:03.782 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd rbd-mirror pv pv pv pv 2024-09-14T21:19:04.953 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 108 kB/s | 84 kB 00:00 2024-09-14T21:19:05.371 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 70 kB/s | 84 kB 00:01 2024-09-14T21:19:05.613 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2024-09-14T21:19:06.106 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 35 kB/s | 24 kB 00:00 2024-09-14T21:19:06.663 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 1.9 kB/s | 1.9 kB 00:01 2024-09-14T21:19:06.823 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-09-14T21:19:07.243 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-14T21:19:09.414 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-14T21:19:09.806 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-14T21:19:12.765 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-14T21:19:13.907 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-14T21:19:15.790 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-14T21:19:16.928 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-14T21:19:18.949 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-14T21:19:20.508 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-14T21:19:21.496 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-14T21:19:23.234 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-14T21:19:25.738 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T21:19:25.739 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T21:19:25.804 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 6.6 k 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 5.5 M 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 900 k 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 145 k 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 1.5 M 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 154 k 2024-09-14T21:19:25.821 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 14 M 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 7.4 M 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 49 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 11 M 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 45 M 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 285 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 784 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 32 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 754 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 127 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: pv x86_64 1.6.20-1.el9 epel 65 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 162 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 321 k 2024-09-14T21:19:25.822 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 306 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 99 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 85 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.2 M 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 171 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.5 M 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.2 M 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 22 M 2024-09-14T21:19:25.823 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 34 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 2.4 M 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 291 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 4.8 M 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 17 M 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 16 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 25 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T21:19:25.824 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 161 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 508 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 5.5 M 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T21:19:25.825 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 45 k 2024-09-14T21:19:25.826 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 143 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T21:19:25.827 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T21:19:25.828 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T21:19:25.829 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T21:19:25.830 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T21:19:25.831 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout:Install 126 Packages 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 2 Packages 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:19:25.832 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 211 M 2024-09-14T21:19:25.833 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-14T21:19:26.794 INFO:teuthology.orchestra.run.smithi169.stdout:(1/128): ceph-19.3.0-4928.g711c10c3.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-09-14T21:19:28.252 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-14T21:19:28.469 INFO:teuthology.orchestra.run.smithi169.stdout:(2/128): ceph-fuse-19.3.0-4928.g711c10c3.el9.x8 537 kB/s | 900 kB 00:01 2024-09-14T21:19:29.019 INFO:teuthology.orchestra.run.smithi169.stdout:(3/128): ceph-immutable-object-cache-19.3.0-492 264 kB/s | 145 kB 00:00 2024-09-14T21:19:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T21:19:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T21:19:30.918 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 6.6 k 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 5.5 M 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 900 k 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 145 k 2024-09-14T21:19:30.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 1.5 M 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 154 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 14 M 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 7.4 M 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 49 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 11 M 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 45 M 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 285 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 784 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 32 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 754 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 127 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: pv x86_64 1.6.20-1.el9 epel 65 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 162 k 2024-09-14T21:19:30.937 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 321 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 306 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 99 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 85 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.2 M 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 171 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.5 M 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 3.2 M 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 22 M 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 34 k 2024-09-14T21:19:30.938 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 2.4 M 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 291 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 4.8 M 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 17 M 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4928.g711c10c3.el9 ceph-noarch 16 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 25 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T21:19:30.939 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 161 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 508 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 5.5 M 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T21:19:30.940 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 45 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.3.0-4928.g711c10c3.el9 ceph 143 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T21:19:30.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T21:19:30.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T21:19:30.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T21:19:30.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T21:19:30.945 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:Install 126 Packages 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:19:30.946 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 211 M 2024-09-14T21:19:30.947 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-14T21:19:32.320 INFO:teuthology.orchestra.run.smithi063.stdout:(1/128): ceph-19.3.0-4928.g711c10c3.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-09-14T21:19:34.937 INFO:teuthology.orchestra.run.smithi063.stdout:(2/128): ceph-fuse-19.3.0-4928.g711c10c3.el9.x8 344 kB/s | 900 kB 00:02 2024-09-14T21:19:35.362 INFO:teuthology.orchestra.run.smithi063.stdout:(3/128): ceph-immutable-object-cache-19.3.0-492 341 kB/s | 145 kB 00:00 2024-09-14T21:19:36.427 INFO:teuthology.orchestra.run.smithi169.stdout:(4/128): ceph-mds-19.3.0-4928.g711c10c3.el9.x86 329 kB/s | 2.4 MB 00:07 2024-09-14T21:19:40.418 INFO:teuthology.orchestra.run.smithi169.stdout:(5/128): ceph-mgr-19.3.0-4928.g711c10c3.el9.x86 391 kB/s | 1.5 MB 00:03 2024-09-14T21:19:42.185 INFO:teuthology.orchestra.run.smithi169.stdout:(6/128): ceph-base-19.3.0-4928.g711c10c3.el9.x8 358 kB/s | 5.5 MB 00:15 2024-09-14T21:19:43.961 INFO:teuthology.orchestra.run.smithi063.stdout:(4/128): ceph-mds-19.3.0-4928.g711c10c3.el9.x86 283 kB/s | 2.4 MB 00:08 2024-09-14T21:19:48.086 INFO:teuthology.orchestra.run.smithi063.stdout:(5/128): ceph-base-19.3.0-4928.g711c10c3.el9.x8 349 kB/s | 5.5 MB 00:16 2024-09-14T21:19:48.948 INFO:teuthology.orchestra.run.smithi063.stdout:(6/128): ceph-mgr-19.3.0-4928.g711c10c3.el9.x86 313 kB/s | 1.5 MB 00:04 2024-09-14T21:19:51.659 INFO:teuthology.orchestra.run.smithi169.stdout:(7/128): ceph-mon-19.3.0-4928.g711c10c3.el9.x86 436 kB/s | 4.8 MB 00:11 2024-09-14T21:20:00.629 INFO:teuthology.orchestra.run.smithi063.stdout:(7/128): ceph-mon-19.3.0-4928.g711c10c3.el9.x86 391 kB/s | 4.8 MB 00:12 2024-09-14T21:20:07.811 INFO:teuthology.orchestra.run.smithi063.stdout:(8/128): ceph-common-19.3.0-4928.g711c10c3.el9. 618 kB/s | 22 MB 00:35 2024-09-14T21:20:07.919 INFO:teuthology.orchestra.run.smithi063.stdout:(9/128): ceph-selinux-19.3.0-4928.g711c10c3.el9 233 kB/s | 25 kB 00:00 2024-09-14T21:20:08.808 INFO:teuthology.orchestra.run.smithi169.stdout:(8/128): ceph-radosgw-19.3.0-4928.g711c10c3.el9 650 kB/s | 11 MB 00:17 2024-09-14T21:20:08.916 INFO:teuthology.orchestra.run.smithi169.stdout:(9/128): ceph-selinux-19.3.0-4928.g711c10c3.el9 233 kB/s | 25 kB 00:00 2024-09-14T21:20:12.016 INFO:teuthology.orchestra.run.smithi169.stdout:(10/128): ceph-common-19.3.0-4928.g711c10c3.el9 486 kB/s | 22 MB 00:45 2024-09-14T21:20:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:(11/128): libcephfs-devel-19.3.0-4928.g711c10c3 273 kB/s | 32 kB 00:00 2024-09-14T21:20:13.175 INFO:teuthology.orchestra.run.smithi169.stdout:(12/128): libcephfs2-19.3.0-4928.g711c10c3.el9. 725 kB/s | 754 kB 00:01 2024-09-14T21:20:13.454 INFO:teuthology.orchestra.run.smithi169.stdout:(13/128): libcephsqlite-19.3.0-4928.g711c10c3.e 579 kB/s | 161 kB 00:00 2024-09-14T21:20:13.651 INFO:teuthology.orchestra.run.smithi169.stdout:(14/128): librados-devel-19.3.0-4928.g711c10c3. 648 kB/s | 127 kB 00:00 2024-09-14T21:20:14.551 INFO:teuthology.orchestra.run.smithi169.stdout:(15/128): libradosstriper1-19.3.0-4928.g711c10c 565 kB/s | 508 kB 00:00 2024-09-14T21:20:18.652 INFO:teuthology.orchestra.run.smithi063.stdout:(10/128): ceph-radosgw-19.3.0-4928.g711c10c3.el 619 kB/s | 11 MB 00:18 2024-09-14T21:20:18.752 INFO:teuthology.orchestra.run.smithi063.stdout:(11/128): libcephfs-devel-19.3.0-4928.g711c10c3 319 kB/s | 32 kB 00:00 2024-09-14T21:20:19.569 INFO:teuthology.orchestra.run.smithi063.stdout:(12/128): libcephfs2-19.3.0-4928.g711c10c3.el9. 925 kB/s | 754 kB 00:00 2024-09-14T21:20:19.744 INFO:teuthology.orchestra.run.smithi063.stdout:(13/128): libcephsqlite-19.3.0-4928.g711c10c3.e 924 kB/s | 161 kB 00:00 2024-09-14T21:20:19.936 INFO:teuthology.orchestra.run.smithi063.stdout:(14/128): librados-devel-19.3.0-4928.g711c10c3. 662 kB/s | 127 kB 00:00 2024-09-14T21:20:20.142 INFO:teuthology.orchestra.run.smithi169.stdout:(16/128): librgw2-19.3.0-4928.g711c10c3.el9.x86 1.0 MB/s | 5.5 MB 00:05 2024-09-14T21:20:20.267 INFO:teuthology.orchestra.run.smithi169.stdout:(17/128): ceph-osd-19.3.0-4928.g711c10c3.el9.x8 462 kB/s | 17 MB 00:38 2024-09-14T21:20:20.301 INFO:teuthology.orchestra.run.smithi169.stdout:(18/128): python3-ceph-argparse-19.3.0-4928.g71 284 kB/s | 45 kB 00:00 2024-09-14T21:20:20.436 INFO:teuthology.orchestra.run.smithi063.stdout:(15/128): libradosstriper1-19.3.0-4928.g711c10c 1.0 MB/s | 508 kB 00:00 2024-09-14T21:20:20.526 INFO:teuthology.orchestra.run.smithi169.stdout:(19/128): python3-ceph-common-19.3.0-4928.g711c 553 kB/s | 143 kB 00:00 2024-09-14T21:20:20.793 INFO:teuthology.orchestra.run.smithi169.stdout:(20/128): python3-cephfs-19.3.0-4928.g711c10c3. 329 kB/s | 162 kB 00:00 2024-09-14T21:20:21.102 INFO:teuthology.orchestra.run.smithi169.stdout:(21/128): python3-rados-19.3.0-4928.g711c10c3.e 558 kB/s | 321 kB 00:00 2024-09-14T21:20:21.277 INFO:teuthology.orchestra.run.smithi169.stdout:(22/128): python3-rgw-19.3.0-4928.g711c10c3.el9 568 kB/s | 99 kB 00:00 2024-09-14T21:20:21.344 INFO:teuthology.orchestra.run.smithi169.stdout:(23/128): python3-rbd-19.3.0-4928.g711c10c3.el9 556 kB/s | 306 kB 00:00 2024-09-14T21:20:21.444 INFO:teuthology.orchestra.run.smithi169.stdout:(24/128): rbd-fuse-19.3.0-4928.g711c10c3.el9.x8 510 kB/s | 85 kB 00:00 2024-09-14T21:20:21.778 INFO:teuthology.orchestra.run.smithi169.stdout:(25/128): rbd-nbd-19.3.0-4928.g711c10c3.el9.x86 513 kB/s | 171 kB 00:00 2024-09-14T21:20:22.361 INFO:teuthology.orchestra.run.smithi169.stdout:(26/128): ceph-grafana-dashboards-19.3.0-4928.g 59 kB/s | 34 kB 00:00 2024-09-14T21:20:22.737 INFO:teuthology.orchestra.run.smithi169.stdout:(27/128): ceph-mgr-cephadm-19.3.0-4928.g711c10c 412 kB/s | 154 kB 00:00 2024-09-14T21:20:23.299 INFO:teuthology.orchestra.run.smithi063.stdout:(16/128): ceph-osd-19.3.0-4928.g711c10c3.el9.x8 512 kB/s | 17 MB 00:34 2024-09-14T21:20:23.420 INFO:teuthology.orchestra.run.smithi063.stdout:(17/128): python3-ceph-argparse-19.3.0-4928.g71 375 kB/s | 45 kB 00:00 2024-09-14T21:20:23.695 INFO:teuthology.orchestra.run.smithi063.stdout:(18/128): python3-ceph-common-19.3.0-4928.g711c 521 kB/s | 143 kB 00:00 2024-09-14T21:20:23.954 INFO:teuthology.orchestra.run.smithi063.stdout:(19/128): python3-cephfs-19.3.0-4928.g711c10c3. 628 kB/s | 162 kB 00:00 2024-09-14T21:20:24.463 INFO:teuthology.orchestra.run.smithi063.stdout:(20/128): python3-rados-19.3.0-4928.g711c10c3.e 631 kB/s | 321 kB 00:00 2024-09-14T21:20:24.879 INFO:teuthology.orchestra.run.smithi063.stdout:(21/128): python3-rbd-19.3.0-4928.g711c10c3.el9 736 kB/s | 306 kB 00:00 2024-09-14T21:20:25.063 INFO:teuthology.orchestra.run.smithi063.stdout:(22/128): python3-rgw-19.3.0-4928.g711c10c3.el9 542 kB/s | 99 kB 00:00 2024-09-14T21:20:25.238 INFO:teuthology.orchestra.run.smithi063.stdout:(23/128): rbd-fuse-19.3.0-4928.g711c10c3.el9.x8 486 kB/s | 85 kB 00:00 2024-09-14T21:20:25.472 INFO:teuthology.orchestra.run.smithi063.stdout:(24/128): librgw2-19.3.0-4928.g711c10c3.el9.x86 1.1 MB/s | 5.5 MB 00:05 2024-09-14T21:20:25.664 INFO:teuthology.orchestra.run.smithi063.stdout:(25/128): rbd-nbd-19.3.0-4928.g711c10c3.el9.x86 893 kB/s | 171 kB 00:00 2024-09-14T21:20:25.764 INFO:teuthology.orchestra.run.smithi063.stdout:(26/128): ceph-grafana-dashboards-19.3.0-4928.g 342 kB/s | 34 kB 00:00 2024-09-14T21:20:25.786 INFO:teuthology.orchestra.run.smithi169.stdout:(28/128): rbd-mirror-19.3.0-4928.g711c10c3.el9. 735 kB/s | 3.2 MB 00:04 2024-09-14T21:20:25.956 INFO:teuthology.orchestra.run.smithi063.stdout:(27/128): ceph-mgr-cephadm-19.3.0-4928.g711c10c 808 kB/s | 154 kB 00:00 2024-09-14T21:20:28.731 INFO:teuthology.orchestra.run.smithi063.stdout:(28/128): rbd-mirror-19.3.0-4928.g711c10c3.el9. 935 kB/s | 3.2 MB 00:03 2024-09-14T21:20:34.077 INFO:teuthology.orchestra.run.smithi169.stdout:(29/128): ceph-mgr-diskprediction-local-19.3.0- 913 kB/s | 7.4 MB 00:08 2024-09-14T21:20:34.386 INFO:teuthology.orchestra.run.smithi169.stdout:(30/128): ceph-mgr-modules-core-19.3.0-4928.g71 944 kB/s | 291 kB 00:00 2024-09-14T21:20:34.486 INFO:teuthology.orchestra.run.smithi169.stdout:(31/128): ceph-mgr-rook-19.3.0-4928.g711c10c3.e 495 kB/s | 49 kB 00:00 2024-09-14T21:20:34.586 INFO:teuthology.orchestra.run.smithi169.stdout:(32/128): ceph-prometheus-alerts-19.3.0-4928.g7 164 kB/s | 16 kB 00:00 2024-09-14T21:20:34.895 INFO:teuthology.orchestra.run.smithi169.stdout:(33/128): ceph-volume-19.3.0-4928.g711c10c3.el9 926 kB/s | 285 kB 00:00 2024-09-14T21:20:35.631 INFO:teuthology.orchestra.run.smithi169.stdout:(34/128): cephadm-19.3.0-4928.g711c10c3.el9.noa 1.0 MB/s | 784 kB 00:00 2024-09-14T21:20:35.720 INFO:teuthology.orchestra.run.smithi169.stdout:(35/128): fuse-2.9.9-16.el9.x86_64.rpm 904 kB/s | 80 kB 00:00 2024-09-14T21:20:35.813 INFO:teuthology.orchestra.run.smithi169.stdout:(36/128): libgfortran-11.5.0-2.el9.x86_64.rpm 8.5 MB/s | 801 kB 00:00 2024-09-14T21:20:35.854 INFO:teuthology.orchestra.run.smithi169.stdout:(37/128): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-14T21:20:35.905 INFO:teuthology.orchestra.run.smithi169.stdout:(38/128): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-14T21:20:35.971 INFO:teuthology.orchestra.run.smithi169.stdout:(39/128): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-14T21:20:36.013 INFO:teuthology.orchestra.run.smithi169.stdout:(40/128): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-14T21:20:36.055 INFO:teuthology.orchestra.run.smithi169.stdout:(41/128): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-14T21:20:36.097 INFO:teuthology.orchestra.run.smithi169.stdout:(42/128): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-14T21:20:36.139 INFO:teuthology.orchestra.run.smithi169.stdout:(43/128): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-14T21:20:36.905 INFO:teuthology.orchestra.run.smithi169.stdout:(44/128): boost-program-options-1.75.0-8.el9.x8 140 kB/s | 107 kB 00:00 2024-09-14T21:20:37.313 INFO:teuthology.orchestra.run.smithi063.stdout:(29/128): ceph-mgr-diskprediction-local-19.3.0- 882 kB/s | 7.4 MB 00:08 2024-09-14T21:20:37.457 INFO:teuthology.orchestra.run.smithi169.stdout:(45/128): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-14T21:20:37.722 INFO:teuthology.orchestra.run.smithi063.stdout:(30/128): ceph-mgr-modules-core-19.3.0-4928.g71 713 kB/s | 291 kB 00:00 2024-09-14T21:20:37.889 INFO:teuthology.orchestra.run.smithi063.stdout:(31/128): ceph-mgr-rook-19.3.0-4928.g711c10c3.e 296 kB/s | 49 kB 00:00 2024-09-14T21:20:37.997 INFO:teuthology.orchestra.run.smithi063.stdout:(32/128): ceph-prometheus-alerts-19.3.0-4928.g7 152 kB/s | 16 kB 00:00 2024-09-14T21:20:38.733 INFO:teuthology.orchestra.run.smithi063.stdout:(33/128): ceph-test-19.3.0-4928.g711c10c3.el9.x 1.5 MB/s | 45 MB 00:30 2024-09-14T21:20:38.765 INFO:teuthology.orchestra.run.smithi063.stdout:(34/128): ceph-volume-19.3.0-4928.g711c10c3.el9 372 kB/s | 285 kB 00:00 2024-09-14T21:20:38.857 INFO:teuthology.orchestra.run.smithi169.stdout:(46/128): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-14T21:20:38.881 INFO:teuthology.orchestra.run.smithi063.stdout:(35/128): fuse-2.9.9-16.el9.x86_64.rpm 687 kB/s | 80 kB 00:00 2024-09-14T21:20:38.998 INFO:teuthology.orchestra.run.smithi063.stdout:(36/128): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-14T21:20:39.065 INFO:teuthology.orchestra.run.smithi063.stdout:(37/128): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-14T21:20:39.141 INFO:teuthology.orchestra.run.smithi063.stdout:(38/128): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-14T21:20:39.174 INFO:teuthology.orchestra.run.smithi063.stdout:(39/128): cephadm-19.3.0-4928.g711c10c3.el9.noa 1.7 MB/s | 784 kB 00:00 2024-09-14T21:20:39.233 INFO:teuthology.orchestra.run.smithi063.stdout:(40/128): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-14T21:20:39.275 INFO:teuthology.orchestra.run.smithi063.stdout:(41/128): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-14T21:20:39.300 INFO:teuthology.orchestra.run.smithi063.stdout:(42/128): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-14T21:20:39.350 INFO:teuthology.orchestra.run.smithi063.stdout:(43/128): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-14T21:20:39.365 INFO:teuthology.orchestra.run.smithi169.stdout:(47/128): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-14T21:20:39.384 INFO:teuthology.orchestra.run.smithi063.stdout:(44/128): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-14T21:20:39.459 INFO:teuthology.orchestra.run.smithi063.stdout:(45/128): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-14T21:20:39.535 INFO:teuthology.orchestra.run.smithi063.stdout:(46/128): flexiblas-3.0.4-8.el9.x86_64.rpm 217 kB/s | 33 kB 00:00 2024-09-14T21:20:39.702 INFO:teuthology.orchestra.run.smithi063.stdout:(47/128): flexiblas-openblas-openmp-3.0.4-8.el9 109 kB/s | 18 kB 00:00 2024-09-14T21:20:39.785 INFO:teuthology.orchestra.run.smithi063.stdout:(48/128): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-14T21:20:39.969 INFO:teuthology.orchestra.run.smithi063.stdout:(49/128): ceph-mgr-dashboard-19.3.0-4928.g711c1 1.0 MB/s | 14 MB 00:14 2024-09-14T21:20:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:(50/128): libpmemobj-1.12.1-1.el9.x86_64.rpm 768 kB/s | 160 kB 00:00 2024-09-14T21:20:40.103 INFO:teuthology.orchestra.run.smithi063.stdout:(51/128): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-09-14T21:20:40.132 INFO:teuthology.orchestra.run.smithi169.stdout:(48/128): libnbd-1.20.2-2.el9.x86_64.rpm 223 kB/s | 171 kB 00:00 2024-09-14T21:20:40.244 INFO:teuthology.orchestra.run.smithi063.stdout:(52/128): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-14T21:20:40.278 INFO:teuthology.orchestra.run.smithi063.stdout:(53/128): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-14T21:20:40.329 INFO:teuthology.orchestra.run.smithi063.stdout:(54/128): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-14T21:20:40.371 INFO:teuthology.orchestra.run.smithi063.stdout:(55/128): openblas-0.3.26-2.el9.x86_64.rpm 420 kB/s | 38 kB 00:00 2024-09-14T21:20:40.438 INFO:teuthology.orchestra.run.smithi063.stdout:(56/128): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2024-09-14T21:20:40.655 INFO:teuthology.orchestra.run.smithi063.stdout:(57/128): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-09-14T21:20:40.849 INFO:teuthology.orchestra.run.smithi169.stdout:(49/128): libpmemobj-1.12.1-1.el9.x86_64.rpm 224 kB/s | 160 kB 00:00 2024-09-14T21:20:40.871 INFO:teuthology.orchestra.run.smithi063.stdout:(58/128): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-14T21:20:40.964 INFO:teuthology.orchestra.run.smithi063.stdout:(59/128): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-14T21:20:41.022 INFO:teuthology.orchestra.run.smithi063.stdout:(60/128): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-14T21:20:41.072 INFO:teuthology.orchestra.run.smithi063.stdout:(61/128): python3-jsonpointer-2.0-4.el9.noarch. 386 kB/s | 19 kB 00:00 2024-09-14T21:20:41.164 INFO:teuthology.orchestra.run.smithi063.stdout:(62/128): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-14T21:20:41.214 INFO:teuthology.orchestra.run.smithi063.stdout:(63/128): python3-markupsafe-1.1.1-12.el9.x86_6 700 kB/s | 35 kB 00:00 2024-09-14T21:20:41.441 INFO:teuthology.orchestra.run.smithi169.stdout:(50/128): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-14T21:20:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:(64/128): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-14T21:20:41.782 INFO:teuthology.orchestra.run.smithi063.stdout:(65/128): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-14T21:20:41.907 INFO:teuthology.orchestra.run.smithi063.stdout:(66/128): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-14T21:20:41.982 INFO:teuthology.orchestra.run.smithi063.stdout:(67/128): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-14T21:20:42.049 INFO:teuthology.orchestra.run.smithi063.stdout:(68/128): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-14T21:20:42.149 INFO:teuthology.orchestra.run.smithi063.stdout:(69/128): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-14T21:20:42.241 INFO:teuthology.orchestra.run.smithi063.stdout:(70/128): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-14T21:20:42.350 INFO:teuthology.orchestra.run.smithi063.stdout:(71/128): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-14T21:20:42.375 INFO:teuthology.orchestra.run.smithi063.stdout:(72/128): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-14T21:20:42.506 INFO:teuthology.orchestra.run.smithi063.stdout:(73/128): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-14T21:20:42.534 INFO:teuthology.orchestra.run.smithi063.stdout:(74/128): python3-pytz-2021.1-5.el9.noarch.rpm 278 kB/s | 51 kB 00:00 2024-09-14T21:20:42.559 INFO:teuthology.orchestra.run.smithi063.stdout:(75/128): python3-requests-oauthlib-1.3.0-12.el 292 kB/s | 54 kB 00:00 2024-09-14T21:20:42.618 INFO:teuthology.orchestra.run.smithi063.stdout:(76/128): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-14T21:20:42.668 INFO:teuthology.orchestra.run.smithi063.stdout:(77/128): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-14T21:20:42.693 INFO:teuthology.orchestra.run.smithi063.stdout:(78/128): qatlib-service-24.02.0-1.el9.x86_64.r 479 kB/s | 36 kB 00:00 2024-09-14T21:20:42.720 INFO:teuthology.orchestra.run.smithi063.stdout:(79/128): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-14T21:20:42.741 INFO:teuthology.orchestra.run.smithi169.stdout:(51/128): librdkafka-1.6.1-102.el9.x86_64.rpm 510 kB/s | 662 kB 00:01 2024-09-14T21:20:42.769 INFO:teuthology.orchestra.run.smithi063.stdout:(80/128): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T21:20:42.834 INFO:teuthology.orchestra.run.smithi063.stdout:(81/128): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-14T21:20:42.901 INFO:teuthology.orchestra.run.smithi063.stdout:(82/128): lua-devel-5.4.4-4.el9.x86_64.rpm 170 kB/s | 22 kB 00:00 2024-09-14T21:20:42.968 INFO:teuthology.orchestra.run.smithi063.stdout:(83/128): protobuf-compiler-3.14.0-13.el9.x86_6 6.3 MB/s | 863 kB 00:00 2024-09-14T21:20:43.027 INFO:teuthology.orchestra.run.smithi063.stdout:(84/128): abseil-cpp-20211102.0-3.el9.x86_64.rp 4.3 MB/s | 548 kB 00:00 2024-09-14T21:20:43.052 INFO:teuthology.orchestra.run.smithi063.stdout:(85/128): grpc-data-1.46.7-10.el9.noarch.rpm 794 kB/s | 19 kB 00:00 2024-09-14T21:20:43.103 INFO:teuthology.orchestra.run.smithi063.stdout:(86/128): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.3 MB/s | 308 kB 00:00 2024-09-14T21:20:43.128 INFO:teuthology.orchestra.run.smithi063.stdout:(87/128): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T21:20:43.153 INFO:teuthology.orchestra.run.smithi063.stdout:(88/128): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T21:20:43.178 INFO:teuthology.orchestra.run.smithi063.stdout:(89/128): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T21:20:43.212 INFO:teuthology.orchestra.run.smithi063.stdout:(90/128): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-14T21:20:43.296 INFO:teuthology.orchestra.run.smithi063.stdout:(91/128): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-09-14T21:20:43.321 INFO:teuthology.orchestra.run.smithi063.stdout:(92/128): pv-1.6.20-1.el9.x86_64.rpm 2.6 MB/s | 65 kB 00:00 2024-09-14T21:20:43.363 INFO:teuthology.orchestra.run.smithi063.stdout:(93/128): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-09-14T21:20:43.380 INFO:teuthology.orchestra.run.smithi063.stdout:(94/128): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.5 MB/s | 43 kB 00:00 2024-09-14T21:20:43.397 INFO:teuthology.orchestra.run.smithi063.stdout:(95/128): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-09-14T21:20:43.413 INFO:teuthology.orchestra.run.smithi063.stdout:(96/128): python3-certifi-2023.05.07-4.el9.noar 868 kB/s | 14 kB 00:00 2024-09-14T21:20:43.447 INFO:teuthology.orchestra.run.smithi063.stdout:(97/128): python3-cheroot-8.6.0-4.el9.noarch.rp 5.0 MB/s | 172 kB 00:00 2024-09-14T21:20:43.489 INFO:teuthology.orchestra.run.smithi063.stdout:(98/128): python3-cherrypy-18.6.1-2.el9.noarch. 8.5 MB/s | 358 kB 00:00 2024-09-14T21:20:43.523 INFO:teuthology.orchestra.run.smithi063.stdout:(99/128): python3-google-auth-2.34.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-09-14T21:20:43.525 INFO:teuthology.orchestra.run.smithi169.stdout:(52/128): lttng-ust-2.12.0-6.el9.x86_64.rpm 374 kB/s | 292 kB 00:00 2024-09-14T21:20:43.598 INFO:teuthology.orchestra.run.smithi063.stdout:(100/128): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-14T21:20:43.657 INFO:teuthology.orchestra.run.smithi063.stdout:(101/128): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-14T21:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout:(102/128): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-14T21:20:43.707 INFO:teuthology.orchestra.run.smithi063.stdout:(103/128): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-14T21:20:43.732 INFO:teuthology.orchestra.run.smithi063.stdout:(104/128): python3-jaraco-collections-3.0.0-8.e 939 kB/s | 23 kB 00:00 2024-09-14T21:20:43.758 INFO:teuthology.orchestra.run.smithi063.stdout:(105/128): python3-jaraco-functools-3.5.0-2.el9 774 kB/s | 19 kB 00:00 2024-09-14T21:20:43.783 INFO:teuthology.orchestra.run.smithi063.stdout:(106/128): python3-jaraco-text-3.2.0-6.el9.noar 798 kB/s | 20 kB 00:00 2024-09-14T21:20:43.850 INFO:teuthology.orchestra.run.smithi063.stdout:(107/128): python3-grpcio-1.46.7-10.el9.x86_64. 6.2 MB/s | 2.0 MB 00:00 2024-09-14T21:20:43.875 INFO:teuthology.orchestra.run.smithi063.stdout:(108/128): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T21:20:43.901 INFO:teuthology.orchestra.run.smithi063.stdout:(109/128): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T21:20:43.926 INFO:teuthology.orchestra.run.smithi063.stdout:(110/128): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T21:20:43.960 INFO:teuthology.orchestra.run.smithi063.stdout:(111/128): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-14T21:20:43.985 INFO:teuthology.orchestra.run.smithi063.stdout:(112/128): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-14T21:20:44.027 INFO:teuthology.orchestra.run.smithi063.stdout:(113/128): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-14T21:20:44.052 INFO:teuthology.orchestra.run.smithi063.stdout:(114/128): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-14T21:20:44.078 INFO:teuthology.orchestra.run.smithi063.stdout:(115/128): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-14T21:20:44.103 INFO:teuthology.orchestra.run.smithi063.stdout:(116/128): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T21:20:44.128 INFO:teuthology.orchestra.run.smithi063.stdout:(117/128): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-14T21:20:44.212 INFO:teuthology.orchestra.run.smithi063.stdout:(118/128): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-14T21:20:44.237 INFO:teuthology.orchestra.run.smithi063.stdout:(119/128): python3-typing-extensions-4.12.2-2.e 685 kB/s | 74 kB 00:00 2024-09-14T21:20:44.271 INFO:teuthology.orchestra.run.smithi063.stdout:(120/128): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-14T21:20:44.296 INFO:teuthology.orchestra.run.smithi063.stdout:(121/128): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-14T21:20:44.321 INFO:teuthology.orchestra.run.smithi063.stdout:(122/128): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-14T21:20:44.355 INFO:teuthology.orchestra.run.smithi063.stdout:(123/128): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T21:20:44.367 INFO:teuthology.orchestra.run.smithi169.stdout:(53/128): lua-5.4.4-4.el9.x86_64.rpm 224 kB/s | 188 kB 00:00 2024-09-14T21:20:44.413 INFO:teuthology.orchestra.run.smithi063.stdout:(124/128): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-14T21:20:44.606 INFO:teuthology.orchestra.run.smithi063.stdout:(125/128): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-09-14T21:20:44.647 INFO:teuthology.orchestra.run.smithi063.stdout:(126/128): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-14T21:20:44.950 INFO:teuthology.orchestra.run.smithi169.stdout:(54/128): openblas-0.3.26-2.el9.x86_64.rpm 66 kB/s | 38 kB 00:00 2024-09-14T21:20:46.009 INFO:teuthology.orchestra.run.smithi169.stdout:(55/128): ceph-mgr-dashboard-19.3.0-4928.g711c1 623 kB/s | 14 MB 00:23 2024-09-14T21:20:47.284 INFO:teuthology.orchestra.run.smithi169.stdout:(56/128): protobuf-3.14.0-13.el9.x86_64.rpm 811 kB/s | 1.0 MB 00:01 2024-09-14T21:20:47.756 INFO:teuthology.orchestra.run.smithi063.stdout:(127/128): librbd1-19.3.0-4928.g711c10c3.el9.x8 1.0 MB/s | 3.2 MB 00:03 2024-09-14T21:20:48.284 INFO:teuthology.orchestra.run.smithi169.stdout:(57/128): openblas-openmp-0.3.26-2.el9.x86_64.r 1.5 MB/s | 4.9 MB 00:03 2024-09-14T21:20:48.843 INFO:teuthology.orchestra.run.smithi169.stdout:(58/128): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-14T21:20:49.076 INFO:teuthology.orchestra.run.smithi169.stdout:(59/128): python3-devel-3.9.19-8.el9.x86_64.rpm 309 kB/s | 245 kB 00:00 2024-09-14T21:20:49.618 INFO:teuthology.orchestra.run.smithi169.stdout:(60/128): python3-jinja2-2.11.3-6.el9.noarch.rp 320 kB/s | 248 kB 00:00 2024-09-14T21:20:49.644 INFO:teuthology.orchestra.run.smithi169.stdout:(61/128): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-14T21:20:50.111 INFO:teuthology.orchestra.run.smithi169.stdout:(62/128): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-14T21:20:50.322 INFO:teuthology.orchestra.run.smithi063.stdout:(128/128): librados2-19.3.0-4928.g711c10c3.el9. 600 kB/s | 3.5 MB 00:05 2024-09-14T21:20:50.328 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-14T21:20:50.328 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.7 MB/s | 211 MB 01:19 2024-09-14T21:20:50.361 INFO:teuthology.orchestra.run.smithi169.stdout:(63/128): python3-mako-1.1.4-6.el9.noarch.rpm 240 kB/s | 172 kB 00:00 2024-09-14T21:20:50.711 INFO:teuthology.orchestra.run.smithi169.stdout:(64/128): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-09-14T21:20:51.470 INFO:teuthology.orchestra.run.smithi169.stdout:(65/128): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-14T21:20:51.495 INFO:teuthology.orchestra.run.smithi169.stdout:(66/128): python3-numpy-f2py-1.20.1-5.el9.x86_6 320 kB/s | 250 kB 00:00 2024-09-14T21:20:51.719 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-14T21:20:51.857 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-14T21:20:51.857 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-14T21:20:52.137 INFO:teuthology.orchestra.run.smithi169.stdout:(67/128): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-14T21:20:52.279 INFO:teuthology.orchestra.run.smithi169.stdout:(68/128): python3-oauthlib-3.1.1-5.el9.noarch.r 275 kB/s | 222 kB 00:00 2024-09-14T21:20:52.737 INFO:teuthology.orchestra.run.smithi169.stdout:(69/128): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-14T21:20:53.154 INFO:teuthology.orchestra.run.smithi169.stdout:(70/128): python3-protobuf-3.14.0-13.el9.noarch 308 kB/s | 269 kB 00:00 2024-09-14T21:20:53.430 INFO:teuthology.orchestra.run.smithi169.stdout:(71/128): python3-pyasn1-0.4.8-6.el9.noarch.rpm 229 kB/s | 159 kB 00:00 2024-09-14T21:20:53.988 INFO:teuthology.orchestra.run.smithi169.stdout:(72/128): python3-pyasn1-modules-0.4.8-6.el9.no 335 kB/s | 279 kB 00:00 2024-09-14T21:20:54.007 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-14T21:20:54.007 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-14T21:20:54.039 INFO:teuthology.orchestra.run.smithi169.stdout:(73/128): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-14T21:20:54.589 INFO:teuthology.orchestra.run.smithi169.stdout:(74/128): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-14T21:20:55.164 INFO:teuthology.orchestra.run.smithi169.stdout:(75/128): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-14T21:20:55.931 INFO:teuthology.orchestra.run.smithi169.stdout:(76/128): qatlib-24.02.0-1.el9.x86_64.rpm 288 kB/s | 221 kB 00:00 2024-09-14T21:20:56.574 INFO:teuthology.orchestra.run.smithi169.stdout:(77/128): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-14T21:20:56.599 INFO:teuthology.orchestra.run.smithi169.stdout:(78/128): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-09-14T21:20:57.175 INFO:teuthology.orchestra.run.smithi169.stdout:(79/128): qatzip-libs-1.2.0-1.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-14T21:20:57.400 INFO:teuthology.orchestra.run.smithi169.stdout:(80/128): socat-1.7.4.1-6.el9.x86_64.rpm 380 kB/s | 304 kB 00:00 2024-09-14T21:20:57.500 INFO:teuthology.orchestra.run.smithi169.stdout:(81/128): lua-devel-5.4.4-4.el9.x86_64.rpm 256 kB/s | 22 kB 00:00 2024-09-14T21:20:57.642 INFO:teuthology.orchestra.run.smithi169.stdout:(82/128): protobuf-compiler-3.14.0-13.el9.x86_6 6.0 MB/s | 863 kB 00:00 2024-09-14T21:20:57.701 INFO:teuthology.orchestra.run.smithi169.stdout:(83/128): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.3 MB/s | 548 kB 00:00 2024-09-14T21:20:57.734 INFO:teuthology.orchestra.run.smithi169.stdout:(84/128): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.0 MB/s | 308 kB 00:00 2024-09-14T21:20:57.760 INFO:teuthology.orchestra.run.smithi169.stdout:(85/128): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-14T21:20:57.827 INFO:teuthology.orchestra.run.smithi169.stdout:(86/128): xmlstarlet-1.6.1-20.el9.x86_64.rpm 98 kB/s | 64 kB 00:00 2024-09-14T21:20:57.877 INFO:teuthology.orchestra.run.smithi169.stdout:(87/128): libarrow-doc-9.0.0-11.el9.noarch.rpm 525 kB/s | 26 kB 00:00 2024-09-14T21:20:57.944 INFO:teuthology.orchestra.run.smithi169.stdout:(88/128): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-14T21:20:57.969 INFO:teuthology.orchestra.run.smithi169.stdout:(89/128): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-14T21:20:57.994 INFO:teuthology.orchestra.run.smithi169.stdout:(90/128): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T21:20:58.045 INFO:teuthology.orchestra.run.smithi169.stdout:(91/128): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-14T21:20:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:(92/128): pv-1.6.20-1.el9.x86_64.rpm 2.6 MB/s | 65 kB 00:00 2024-09-14T21:20:58.120 INFO:teuthology.orchestra.run.smithi169.stdout:(93/128): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-14T21:20:58.145 INFO:teuthology.orchestra.run.smithi169.stdout:(94/128): python3-asyncssh-2.13.2-5.el9.noarch. 7.1 MB/s | 548 kB 00:00 2024-09-14T21:20:58.171 INFO:teuthology.orchestra.run.smithi169.stdout:(95/128): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2024-09-14T21:20:58.196 INFO:teuthology.orchestra.run.smithi169.stdout:(96/128): python3-cachetools-4.2.4-1.el9.noarch 642 kB/s | 32 kB 00:00 2024-09-14T21:20:58.221 INFO:teuthology.orchestra.run.smithi169.stdout:(97/128): python3-certifi-2023.05.07-4.el9.noar 282 kB/s | 14 kB 00:00 2024-09-14T21:20:58.247 INFO:teuthology.orchestra.run.smithi169.stdout:(98/128): python3-cheroot-8.6.0-4.el9.noarch.rp 3.3 MB/s | 172 kB 00:00 2024-09-14T21:20:58.289 INFO:teuthology.orchestra.run.smithi169.stdout:(99/128): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-09-14T21:20:58.314 INFO:teuthology.orchestra.run.smithi169.stdout:(100/128): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-14T21:20:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:(101/128): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T21:20:58.373 INFO:teuthology.orchestra.run.smithi169.stdout:(102/128): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-14T21:20:58.398 INFO:teuthology.orchestra.run.smithi169.stdout:(103/128): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-14T21:20:58.423 INFO:teuthology.orchestra.run.smithi169.stdout:(104/128): python3-jaraco-collections-3.0.0-8.e 941 kB/s | 23 kB 00:00 2024-09-14T21:20:58.449 INFO:teuthology.orchestra.run.smithi169.stdout:(105/128): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-14T21:20:58.476 INFO:teuthology.orchestra.run.smithi169.stdout:(106/128): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-14T21:20:58.533 INFO:teuthology.orchestra.run.smithi169.stdout:(107/128): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-14T21:20:58.558 INFO:teuthology.orchestra.run.smithi169.stdout:(108/128): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T21:20:58.583 INFO:teuthology.orchestra.run.smithi169.stdout:(109/128): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T21:20:58.625 INFO:teuthology.orchestra.run.smithi169.stdout:(110/128): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-14T21:20:58.676 INFO:teuthology.orchestra.run.smithi169.stdout:(111/128): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-09-14T21:20:58.701 INFO:teuthology.orchestra.run.smithi169.stdout:(112/128): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-14T21:20:58.726 INFO:teuthology.orchestra.run.smithi169.stdout:(113/128): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-14T21:20:58.752 INFO:teuthology.orchestra.run.smithi169.stdout:(114/128): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-14T21:20:58.777 INFO:teuthology.orchestra.run.smithi169.stdout:(115/128): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-14T21:20:58.802 INFO:teuthology.orchestra.run.smithi169.stdout:(116/128): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T21:20:58.827 INFO:teuthology.orchestra.run.smithi169.stdout:(117/128): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T21:20:58.878 INFO:teuthology.orchestra.run.smithi169.stdout:(118/128): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-09-14T21:20:58.903 INFO:teuthology.orchestra.run.smithi169.stdout:(119/128): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-09-14T21:20:58.928 INFO:teuthology.orchestra.run.smithi169.stdout:(120/128): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-14T21:20:58.962 INFO:teuthology.orchestra.run.smithi169.stdout:(121/128): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-14T21:20:58.987 INFO:teuthology.orchestra.run.smithi169.stdout:(122/128): python3-zc-lockfile-2.0-10.el9.noarc 813 kB/s | 20 kB 00:00 2024-09-14T21:20:59.021 INFO:teuthology.orchestra.run.smithi169.stdout:(123/128): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T21:20:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:(124/128): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-14T21:20:59.113 INFO:teuthology.orchestra.run.smithi169.stdout:(125/128): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-14T21:20:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-14T21:20:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/130 2024-09-14T21:20:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/130 2024-09-14T21:21:00.017 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/130 2024-09-14T21:21:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/130 2024-09-14T21:21:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 5/130 2024-09-14T21:21:00.666 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 5/130 2024-09-14T21:21:00.710 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:21:00.830 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:21:00.883 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 7/130 2024-09-14T21:21:00.920 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/130 2024-09-14T21:21:00.957 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/130 2024-09-14T21:21:01.004 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 10/130 2024-09-14T21:21:01.038 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:21:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:21:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 12/130 2024-09-14T21:21:01.297 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 12/130 2024-09-14T21:21:01.323 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/130 2024-09-14T21:21:01.362 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/130 2024-09-14T21:21:01.732 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/130 2024-09-14T21:21:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/130 2024-09-14T21:21:01.916 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/130 2024-09-14T21:21:01.959 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/130 2024-09-14T21:21:02.003 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 17/130 2024-09-14T21:21:02.089 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/130 2024-09-14T21:21:02.147 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/130 2024-09-14T21:21:02.205 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 20/130 2024-09-14T21:21:02.265 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/130 2024-09-14T21:21:02.288 INFO:teuthology.orchestra.run.smithi169.stdout:(126/128): librbd1-19.3.0-4928.g711c10c3.el9.x8 1.0 MB/s | 3.2 MB 00:03 2024-09-14T21:21:02.312 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/130 2024-09-14T21:21:02.345 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/130 2024-09-14T21:21:02.439 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/130 2024-09-14T21:21:02.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 25/130 2024-09-14T21:21:02.541 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/130 2024-09-14T21:21:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 27/130 2024-09-14T21:21:02.714 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 28/130 2024-09-14T21:21:02.760 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.3.0-4928.g711c10c3.el9. 29/130 2024-09-14T21:21:02.813 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el 30/130 2024-09-14T21:21:02.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_6 31/130 2024-09-14T21:21:02.938 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/130 2024-09-14T21:21:03.027 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/130 2024-09-14T21:21:03.125 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/130 2024-09-14T21:21:03.306 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/130 2024-09-14T21:21:03.414 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/130 2024-09-14T21:21:04.105 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/130 2024-09-14T21:21:04.217 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/130 2024-09-14T21:21:04.258 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 39/130 2024-09-14T21:21:04.301 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/130 2024-09-14T21:21:04.340 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_6 41/130 2024-09-14T21:21:04.381 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/130 2024-09-14T21:21:04.501 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 43/130 2024-09-14T21:21:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 44/130 2024-09-14T21:21:04.674 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/130 2024-09-14T21:21:04.716 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 46/130 2024-09-14T21:21:04.752 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 47/130 2024-09-14T21:21:04.812 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/130 2024-09-14T21:21:04.864 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/130 2024-09-14T21:21:04.940 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/130 2024-09-14T21:21:05.123 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/130 2024-09-14T21:21:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/130 2024-09-14T21:21:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 53/130 2024-09-14T21:21:05.288 INFO:teuthology.orchestra.run.smithi169.stdout:(127/128): ceph-test-19.3.0-4928.g711c10c3.el9. 826 kB/s | 45 MB 00:56 2024-09-14T21:21:05.381 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/130 2024-09-14T21:21:05.430 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 55/130 2024-09-14T21:21:05.473 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/130 2024-09-14T21:21:05.510 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 57/130 2024-09-14T21:21:05.534 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 58/130 2024-09-14T21:21:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 59/130 2024-09-14T21:21:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 60/130 2024-09-14T21:21:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 61/130 2024-09-14T21:21:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/130 2024-09-14T21:21:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 63/130 2024-09-14T21:21:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 64/130 2024-09-14T21:21:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 65/130 2024-09-14T21:21:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 66/130 2024-09-14T21:21:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 67/130 2024-09-14T21:21:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 68/130 2024-09-14T21:21:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 69/130 2024-09-14T21:21:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 70/130 2024-09-14T21:21:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/130 2024-09-14T21:21:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 72/130 2024-09-14T21:21:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 73/130 2024-09-14T21:21:07.254 INFO:teuthology.orchestra.run.smithi169.stdout:(128/128): librados2-19.3.0-4928.g711c10c3.el9. 432 kB/s | 3.5 MB 00:08 2024-09-14T21:21:07.261 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-14T21:21:07.261 INFO:teuthology.orchestra.run.smithi169.stdout:Total 2.1 MB/s | 211 MB 01:41 2024-09-14T21:21:07.608 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/130 2024-09-14T21:21:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 75/130 2024-09-14T21:21:07.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 76/130 2024-09-14T21:21:07.823 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 77/130 2024-09-14T21:21:07.877 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 78/130 2024-09-14T21:21:08.159 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 79/130 2024-09-14T21:21:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 80/130 2024-09-14T21:21:08.330 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/130 2024-09-14T21:21:08.628 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-14T21:21:08.756 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-14T21:21:08.756 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-14T21:21:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/130 2024-09-14T21:21:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/130 2024-09-14T21:21:10.845 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-14T21:21:10.845 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-14T21:21:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/130 2024-09-14T21:21:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/130 2024-09-14T21:21:11.580 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/130 2024-09-14T21:21:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 87/130 2024-09-14T21:21:11.806 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 87/130 2024-09-14T21:21:11.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 88/130 2024-09-14T21:21:11.889 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 89/130 2024-09-14T21:21:12.457 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 90/130 2024-09-14T21:21:12.495 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 91/130 2024-09-14T21:21:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 91/130 2024-09-14T21:21:12.646 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 92/130 2024-09-14T21:21:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-14T21:21:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/130 2024-09-14T21:21:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/130 2024-09-14T21:21:16.345 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:16.396 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/130 2024-09-14T21:21:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 94/130 2024-09-14T21:21:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 94/130 2024-09-14T21:21:16.604 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T21:21:16.604 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T21:21:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 95/130 2024-09-14T21:21:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/130 2024-09-14T21:21:16.883 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 5/130 2024-09-14T21:21:17.028 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 5/130 2024-09-14T21:21:17.059 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:21:17.175 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:21:17.259 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 7/130 2024-09-14T21:21:17.298 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/130 2024-09-14T21:21:17.339 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/130 2024-09-14T21:21:17.394 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 10/130 2024-09-14T21:21:17.421 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:21:17.532 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:21:17.563 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 12/130 2024-09-14T21:21:17.646 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 12/130 2024-09-14T21:21:17.673 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/130 2024-09-14T21:21:17.716 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/130 2024-09-14T21:21:17.948 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/130 2024-09-14T21:21:17.984 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/130 2024-09-14T21:21:18.117 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/130 2024-09-14T21:21:18.147 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/130 2024-09-14T21:21:18.192 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 17/130 2024-09-14T21:21:18.274 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/130 2024-09-14T21:21:18.337 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/130 2024-09-14T21:21:18.375 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 20/130 2024-09-14T21:21:18.430 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/130 2024-09-14T21:21:18.468 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/130 2024-09-14T21:21:18.526 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/130 2024-09-14T21:21:18.616 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/130 2024-09-14T21:21:18.679 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 25/130 2024-09-14T21:21:18.730 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/130 2024-09-14T21:21:18.776 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 27/130 2024-09-14T21:21:18.858 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 28/130 2024-09-14T21:21:18.892 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.3.0-4928.g711c10c3.el9. 29/130 2024-09-14T21:21:18.937 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el 30/130 2024-09-14T21:21:18.964 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_6 31/130 2024-09-14T21:21:19.057 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/130 2024-09-14T21:21:19.109 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/130 2024-09-14T21:21:19.217 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/130 2024-09-14T21:21:19.387 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/130 2024-09-14T21:21:19.454 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/130 2024-09-14T21:21:20.104 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/130 2024-09-14T21:21:20.205 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/130 2024-09-14T21:21:20.248 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 39/130 2024-09-14T21:21:20.291 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/130 2024-09-14T21:21:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_6 41/130 2024-09-14T21:21:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/130 2024-09-14T21:21:20.507 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 43/130 2024-09-14T21:21:20.574 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 44/130 2024-09-14T21:21:20.660 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/130 2024-09-14T21:21:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 46/130 2024-09-14T21:21:20.734 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 47/130 2024-09-14T21:21:20.794 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/130 2024-09-14T21:21:20.846 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/130 2024-09-14T21:21:20.896 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/130 2024-09-14T21:21:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/130 2024-09-14T21:21:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/130 2024-09-14T21:21:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 53/130 2024-09-14T21:21:21.283 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/130 2024-09-14T21:21:21.321 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 55/130 2024-09-14T21:21:21.363 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/130 2024-09-14T21:21:21.400 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 57/130 2024-09-14T21:21:21.425 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 58/130 2024-09-14T21:21:21.546 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 59/130 2024-09-14T21:21:21.707 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 60/130 2024-09-14T21:21:21.757 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 61/130 2024-09-14T21:21:21.805 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/130 2024-09-14T21:21:21.844 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 63/130 2024-09-14T21:21:21.881 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 64/130 2024-09-14T21:21:21.916 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 65/130 2024-09-14T21:21:21.950 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 66/130 2024-09-14T21:21:21.993 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 67/130 2024-09-14T21:21:22.025 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 68/130 2024-09-14T21:21:22.127 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 69/130 2024-09-14T21:21:22.176 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 70/130 2024-09-14T21:21:22.212 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/130 2024-09-14T21:21:22.337 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 72/130 2024-09-14T21:21:22.418 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 73/130 2024-09-14T21:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/130 2024-09-14T21:21:23.377 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 75/130 2024-09-14T21:21:23.411 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 76/130 2024-09-14T21:21:23.529 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 77/130 2024-09-14T21:21:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 78/130 2024-09-14T21:21:23.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 79/130 2024-09-14T21:21:23.891 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 80/130 2024-09-14T21:21:23.995 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/130 2024-09-14T21:21:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/130 2024-09-14T21:21:24.950 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/130 2024-09-14T21:21:26.555 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/130 2024-09-14T21:21:26.661 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/130 2024-09-14T21:21:27.009 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/130 2024-09-14T21:21:27.062 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 87/130 2024-09-14T21:21:27.182 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 87/130 2024-09-14T21:21:27.217 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 88/130 2024-09-14T21:21:27.271 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 89/130 2024-09-14T21:21:27.801 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 90/130 2024-09-14T21:21:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 91/130 2024-09-14T21:21:27.922 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 91/130 2024-09-14T21:21:27.958 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 92/130 2024-09-14T21:21:29.863 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 95/130 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-14T21:21:29.864 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:30.072 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 96/130 2024-09-14T21:21:30.108 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 96/130 2024-09-14T21:21:30.108 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:30.108 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T21:21:30.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:30.545 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:30.587 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:31.229 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 93/130 2024-09-14T21:21:31.299 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 94/130 2024-09-14T21:21:31.433 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 94/130 2024-09-14T21:21:31.434 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T21:21:31.434 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T21:21:31.434 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:31.467 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 95/130 2024-09-14T21:21:31.834 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 97/130 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 97/130 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T21:21:31.893 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 98/130 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 98/130 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T21:21:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:32.727 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 99/130 2024-09-14T21:21:32.778 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 99/130 2024-09-14T21:21:32.778 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:32.778 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T21:21:32.779 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T21:21:32.779 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T21:21:32.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:32.880 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 100/130 2024-09-14T21:21:32.953 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 101/130 2024-09-14T21:21:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 102/130 2024-09-14T21:21:33.265 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 103/130 2024-09-14T21:21:33.383 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/130 2024-09-14T21:21:33.504 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 105/130 2024-09-14T21:21:33.682 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 106/130 2024-09-14T21:21:33.739 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 107/130 2024-09-14T21:21:33.778 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 108/130 2024-09-14T21:21:33.803 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 109/130 2024-09-14T21:21:34.312 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 110/130 2024-09-14T21:21:34.377 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 110/130 2024-09-14T21:21:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.e 111/130 2024-09-14T21:21:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3. 112/130 2024-09-14T21:21:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 113/130 2024-09-14T21:21:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 113/130 2024-09-14T21:21:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 114/130 2024-09-14T21:21:39.647 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 114/130 2024-09-14T21:21:39.672 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 115/130 2024-09-14T21:21:39.831 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 115/130 2024-09-14T21:21:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el 116/130 2024-09-14T21:21:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 117/130 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 117/130 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T21:21:40.102 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:40.167 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 118/130 2024-09-14T21:21:40.193 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 118/130 2024-09-14T21:21:40.305 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 119/130 2024-09-14T21:21:41.400 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 120/130 2024-09-14T21:21:41.435 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 121/130 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 121/130 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T21:21:41.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:41.536 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4928.g711c1 122/130 2024-09-14T21:21:41.586 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4928.g711c1 122/130 2024-09-14T21:21:41.586 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:41.586 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T21:21:41.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:41.953 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 123/130 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 123/130 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T21:21:42.005 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:44.286 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 95/130 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-14T21:21:44.287 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:44.510 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 96/130 2024-09-14T21:21:44.547 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 96/130 2024-09-14T21:21:44.547 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:44.547 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T21:21:44.547 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:46.189 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 97/130 2024-09-14T21:21:46.247 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 97/130 2024-09-14T21:21:46.248 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:46.248 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T21:21:46.248 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T21:21:46.248 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T21:21:46.248 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:46.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 98/130 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 98/130 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T21:21:46.541 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:46.992 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 124/130 2024-09-14T21:21:47.032 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 99/130 2024-09-14T21:21:47.041 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 125/130 2024-09-14T21:21:47.072 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 126/130 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 99/130 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T21:21:47.084 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_ 127/130 2024-09-14T21:21:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : pv-1.6.20-1.el9.x86_64 128/130 2024-09-14T21:21:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 129/130 2024-09-14T21:21:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 100/130 2024-09-14T21:21:47.239 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 101/130 2024-09-14T21:21:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 129/130 2024-09-14T21:21:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:21:47.466 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 102/130 2024-09-14T21:21:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 103/130 2024-09-14T21:21:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:21:47.628 INFO:teuthology.orchestra.run.smithi063.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-14T21:21:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:47.647 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/130 2024-09-14T21:21:47.756 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 105/130 2024-09-14T21:21:47.932 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 106/130 2024-09-14T21:21:47.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 107/130 2024-09-14T21:21:48.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 108/130 2024-09-14T21:21:48.058 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 109/130 2024-09-14T21:21:48.934 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 110/130 2024-09-14T21:21:48.966 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 110/130 2024-09-14T21:21:49.009 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.e 111/130 2024-09-14T21:21:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3. 112/130 2024-09-14T21:21:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 113/130 2024-09-14T21:21:52.760 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 113/130 2024-09-14T21:21:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 114/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 1/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 2/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 3/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 4/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4928.g711c1 5/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:21:53.149 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 7/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 8/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 9/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 10/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 12/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_ 13/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 14/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 15/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_6 16/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 17/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 18/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el 19/130 2024-09-14T21:21:53.150 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.3.0-4928.g711c10c3.el9. 20/130 2024-09-14T21:21:53.151 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_6 21/130 2024-09-14T21:21:53.151 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 22/130 2024-09-14T21:21:53.151 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 23/130 2024-09-14T21:21:53.151 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 24/130 2024-09-14T21:21:53.151 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 25/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 26/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 27/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3. 28/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 29/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 30/130 2024-09-14T21:21:53.160 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 31/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el 32/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 33/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.e 34/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 35/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 36/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/130 2024-09-14T21:21:53.161 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 50/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 51/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 52/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 53/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/130 2024-09-14T21:21:53.162 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 55/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 56/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 57/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 59/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 60/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 61/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 62/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 63/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 64/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 65/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 66/130 2024-09-14T21:21:53.163 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 67/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 68/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 69/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 70/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 71/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 72/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 73/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 74/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 76/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 77/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 78/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 79/130 2024-09-14T21:21:53.164 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 80/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 81/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 83/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 84/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 85/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 86/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 87/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 88/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 89/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 90/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 91/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 92/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : pv-1.6.20-1.el9.x86_64 94/130 2024-09-14T21:21:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 95/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 96/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 97/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 98/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 99/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 100/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 101/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 102/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 104/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 105/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 106/130 2024-09-14T21:21:53.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 107/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 108/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 109/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 110/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 111/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 112/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 113/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 114/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 116/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 117/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 118/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 119/130 2024-09-14T21:21:53.167 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 120/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 121/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 122/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 123/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 124/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 125/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 126/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 127/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 128/130 2024-09-14T21:21:53.168 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 129/130 2024-09-14T21:21:53.915 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 114/130 2024-09-14T21:21:53.962 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 115/130 2024-09-14T21:21:54.113 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 115/130 2024-09-14T21:21:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el 116/130 2024-09-14T21:21:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 117/130 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 117/130 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T21:21:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 118/130 2024-09-14T21:21:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 118/130 2024-09-14T21:21:54.589 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 119/130 2024-09-14T21:21:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 120/130 2024-09-14T21:21:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 121/130 2024-09-14T21:21:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 121/130 2024-09-14T21:21:55.708 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:55.708 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T21:21:55.708 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T21:21:55.709 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T21:21:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:55.758 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4928.g711c1 122/130 2024-09-14T21:21:55.808 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4928.g711c1 122/130 2024-09-14T21:21:55.808 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:55.808 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T21:21:55.808 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:21:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:55.900 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-14T21:21:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T21:21:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T21:21:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: pv-1.6.20-1.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T21:21:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T21:21:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T21:21:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T21:21:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T21:21:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T21:21:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T21:21:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:21:55.911 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-14T21:21:56.193 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 123/130 2024-09-14T21:21:56.243 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 123/130 2024-09-14T21:21:56.244 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T21:21:56.244 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T21:21:56.244 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T21:21:56.244 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T21:21:56.244 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:21:56.411 DEBUG:teuthology.parallel:result is None 2024-09-14T21:22:00.914 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 124/130 2024-09-14T21:22:00.955 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 125/130 2024-09-14T21:22:00.986 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 126/130 2024-09-14T21:22:01.031 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_ 127/130 2024-09-14T21:22:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pv-1.6.20-1.el9.x86_64 128/130 2024-09-14T21:22:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 129/130 2024-09-14T21:22:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 129/130 2024-09-14T21:22:01.218 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:22:01.675 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:22:01.675 INFO:teuthology.orchestra.run.smithi169.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-14T21:22:01.675 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:07.135 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 1/130 2024-09-14T21:22:07.135 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 2/130 2024-09-14T21:22:07.135 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 3/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 4/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4928.g711c1 5/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 6/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 7/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 8/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 9/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 10/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 11/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 12/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_ 13/130 2024-09-14T21:22:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 14/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 15/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_6 16/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86 17/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 18/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el 19/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.3.0-4928.g711c10c3.el9. 20/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_6 21/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 22/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 23/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 24/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 25/130 2024-09-14T21:22:07.137 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 26/130 2024-09-14T21:22:07.138 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 27/130 2024-09-14T21:22:07.138 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3. 28/130 2024-09-14T21:22:07.138 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noa 29/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.n 30/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4928.g711 31/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el 32/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 33/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.e 34/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 35/130 2024-09-14T21:22:07.146 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 36/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 50/130 2024-09-14T21:22:07.147 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 51/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 52/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 53/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 55/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 56/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 57/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 59/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 60/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 61/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 62/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 63/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 64/130 2024-09-14T21:22:07.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 65/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 66/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 67/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 68/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 69/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 70/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 71/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 72/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 73/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 74/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 76/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 77/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 78/130 2024-09-14T21:22:07.149 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 79/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 80/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 81/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 83/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 84/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 85/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 86/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 87/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 88/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 89/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 90/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 91/130 2024-09-14T21:22:07.150 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 92/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pv-1.6.20-1.el9.x86_64 94/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 95/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 96/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 97/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 98/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 99/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 100/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 101/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 102/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 104/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 105/130 2024-09-14T21:22:07.151 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 106/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 107/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 108/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 109/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 110/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 111/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 112/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 113/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 114/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 116/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 117/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 118/130 2024-09-14T21:22:07.152 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 119/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 120/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 121/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 122/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 123/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 124/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 125/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 126/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 127/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 128/130 2024-09-14T21:22:07.153 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 129/130 2024-09-14T21:22:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 130/130 2024-09-14T21:22:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:09.291 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-14T21:22:09.291 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.3.0-4928.g711c10c3.el9.noarch 2024-09-14T21:22:09.293 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T21:22:09.294 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T21:22:09.295 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: pv-1.6.20-1.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T21:22:09.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T21:22:09.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T21:22:09.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.300 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.3.0-4928.g711c10c3.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:09.301 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-14T21:22:09.767 DEBUG:teuthology.parallel:result is None 2024-09-14T21:22:09.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:22:09.910 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T21:22:09.960 INFO:teuthology.orchestra.run.smithi063.stdout:19.3.0-4928.g711c10c3.el9 2024-09-14T21:22:09.961 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4928.g711c10c3.el9 2024-09-14T21:22:09.961 INFO:teuthology.task.install:The correct ceph version 19.3.0-4928.g711c10c3 is installed. 2024-09-14T21:22:09.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:22:10.099 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T21:22:10.144 INFO:teuthology.orchestra.run.smithi169.stdout:19.3.0-4928.g711c10c3.el9 2024-09-14T21:22:10.145 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4928.g711c10c3.el9 2024-09-14T21:22:10.145 INFO:teuthology.task.install:The correct ceph version 19.3.0-4928.g711c10c3 is installed. 2024-09-14T21:22:10.147 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T21:22:10.147 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:10.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T21:22:10.211 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:10.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T21:22:10.270 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T21:22:10.270 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:10.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T21:22:10.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T21:22:10.424 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:10.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T21:22:10.480 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T21:22:10.576 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T21:22:10.577 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:10.577 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T21:22:10.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T21:22:10.729 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:10.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T21:22:10.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T21:22:10.879 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T21:22:10.879 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:10.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T21:22:10.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T21:22:11.032 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:11.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T21:22:11.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T21:22:11.183 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T21:22:11.260 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T21:22:11.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-14T21:22:11.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-09-14T21:22:11.319 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T21:22:11.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T21:22:11.323 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T21:22:11.377 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T21:22:11.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T21:22:11.381 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T21:22:11.444 INFO:tasks.ceph:Creating ceph cluster cluster1... 2024-09-14T21:22:11.445 INFO:tasks.ceph:config {'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'cluster1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T21:22:11.445 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598', 'branch': 'main', 'description': 'krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{legacy} tasks/compare-mirror-images}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904598', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': '2 ceph clusters with 1 mon, 1 mgr and 3 osd each'}], 'name': 'teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}, 'extra_system_packages': ['pv']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2'], ['cluster2.mon.a', 'cluster2.mgr.x', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster2.client.mirror', 'cluster2.client.mirror.0']], 'seed': 8145, 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'krbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_711c10c3b606220cc536e8cfed3eb9d03ecd33d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdDtSlVWGp9Vj2qzHuL58OVrpq3fzHe/2RVQK/fgVZn64i26CHL6650A+11TNPKW+2jiNWTo2aKDSlc9AkB49w=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3JpJXPmEtDM2SWMCJoeLVs37Pm9b51micdFDljVDo8cuFytRuis/x7K/cICcGqkvDBu+5JC8TJ84OMczgdnhM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'extra_system_packages': ['pv']}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}}, {'ceph': {'cluster': 'cluster2'}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': False}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': False}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/compare_mirror_images.sh']}, 'env': {'RBD_DEVICE_TYPE': 'krbd', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '3h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-14_20:48:16', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T21:22:11.445 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2024-09-14T21:22:11.449 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2024-09-14T21:22:11.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T21:22:11.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T21:22:11.579 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:11.579 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T21:22:11.614 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T21:22:11.614 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-14T21:22:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T21:22:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:11.689 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-14T21:22:11.689 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:11.689 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:11.690 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-14 21:21:47.942314765 +0000 2024-09-14T21:22:11.690 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-14 21:18:37.437597830 +0000 2024-09-14T21:22:11.690 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-14 21:18:37.437597830 +0000 2024-09-14T21:22:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-14 21:18:37.437597830 +0000 2024-09-14T21:22:11.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T21:22:11.783 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-14T21:22:11.784 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-14T21:22:11.784 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00026987 s, 1.9 MB/s 2024-09-14T21:22:11.785 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T21:22:11.821 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-14 21:21:47.943314755 +0000 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-14 21:18:37.913593104 +0000 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-14 21:18:37.913593104 +0000 2024-09-14T21:22:11.896 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-14 21:18:37.913593104 +0000 2024-09-14T21:22:11.897 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T21:22:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-14T21:22:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-14T21:22:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000471214 s, 1.1 MB/s 2024-09-14T21:22:11.992 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T21:22:12.028 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-14 21:21:47.943314755 +0000 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-14 21:18:38.367588596 +0000 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-14 21:18:38.367588596 +0000 2024-09-14T21:22:12.103 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-14 21:18:38.367588596 +0000 2024-09-14T21:22:12.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T21:22:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-14T21:22:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-14T21:22:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000315504 s, 1.6 MB/s 2024-09-14T21:22:12.198 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T21:22:12.234 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-14T21:22:12.309 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-14 21:21:47.945314735 +0000 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-14 21:18:38.812584178 +0000 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-14 21:18:38.812584178 +0000 2024-09-14T21:22:12.310 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-14 21:18:38.812584178 +0000 2024-09-14T21:22:12.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T21:22:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-14T21:22:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-14T21:22:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000269074 s, 1.9 MB/s 2024-09-14T21:22:12.405 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T21:22:12.441 INFO:tasks.ceph:osd dev map: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:12.442 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-14T21:22:12.442 INFO:tasks.ceph:Generating config... 2024-09-14T21:22:12.443 INFO:tasks.ceph:[client] rbd default map options = ms_mode=legacy 2024-09-14T21:22:12.443 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T21:22:12.443 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-14T21:22:12.443 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T21:22:12.443 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T21:22:12.443 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T21:22:12.443 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T21:22:12.443 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T21:22:12.443 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T21:22:12.443 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T21:22:12.444 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T21:22:12.445 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T21:22:12.445 INFO:tasks.ceph:Setting up cluster1.mon.a... 2024-09-14T21:22:12.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster1.keyring 2024-09-14T21:22:12.566 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/cluster1.keyring 2024-09-14T21:22:12.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster1.keyring 2024-09-14T21:22:12.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-14T21:22:12.713 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster1.mon.a', '172.21.15.63')] 2024-09-14T21:22:12.713 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63', 'mon warn on pool no app': False, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default map options': 'ms_mode=legacy'}, 'mon.a': {}} 2024-09-14T21:22:12.714 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:12.714 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T21:22:12.749 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --print /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 2e86c927-73e2-48b0-b6e4-a356a5cdc207 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 2e86c927-73e2-48b0-b6e4-a356a5cdc207 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-14T21:22:12.859094+0000 2024-09-14T21:22:12.860 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-14T21:22:12.859094+0000 2024-09-14T21:22:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-14T21:22:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-14T21:22:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-14T21:22:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster1.monmap (1 monitors) 2024-09-14T21:22:12.863 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T21:22:12.897 INFO:tasks.ceph:Writing /etc/ceph/cluster1.conf for FSID 2e86c927-73e2-48b0-b6e4-a356a5cdc207... 2024-09-14T21:22:12.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2024-09-14T21:22:12.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2024-09-14T21:22:13.034 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.035 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T21:22:13.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-14T21:22:13.037 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-14T21:22:13.038 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = 172.21.15.63 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on pool no app = False 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 2e86c927-73e2-48b0-b6e4-a356a5cdc207 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.039 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-14T21:22:13.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-09-14T21:22:13.041 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-14T21:22:13.042 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-14T21:22:13.043 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T21:22:13.044 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T21:22:13.045 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi063.stdout: rbd default map options = ms_mode=legacy 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T21:22:13.046 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.047 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T21:22:13.048 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = 172.21.15.63 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 2e86c927-73e2-48b0-b6e4-a356a5cdc207 2024-09-14T21:22:13.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-14T21:22:13.050 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.051 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-14T21:22:13.052 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.053 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.054 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T21:22:13.055 INFO:teuthology.orchestra.run.smithi169.stdout: rbd default map options = ms_mode=legacy 2024-09-14T21:22:13.056 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-14T21:22:13.072 INFO:tasks.ceph:Creating admin key on cluster1.mon.a... 2024-09-14T21:22:13.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster1.keyring 2024-09-14T21:22:13.170 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T21:22:13.170 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:13.170 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/cluster1.keyring of=/dev/stdout 2024-09-14T21:22:13.205 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:13.205 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/cluster1.monmap of=/dev/stdout 2024-09-14T21:22:13.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T21:22:13.279 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:13.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/cluster1.keyring 2024-09-14T21:22:13.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-14T21:22:13.396 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:13.397 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:13.472 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T21:22:13.472 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:13.472 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/cluster1.keyring 2024-09-14T21:22:13.472 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-14T21:22:13.553 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:13.553 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:13.630 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T21:22:13.630 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T21:22:13.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/cluster1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster1-x/keyring 2024-09-14T21:22:13.733 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/cluster1-x/keyring 2024-09-14T21:22:13.739 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T21:22:13.739 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T21:22:13.740 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster1.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.keyring 2024-09-14T21:22:13.835 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/cluster1.client.mirror.keyring 2024-09-14T21:22:13.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster1.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.0.keyring 2024-09-14T21:22:13.945 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/cluster1.client.mirror.0.keyring 2024-09-14T21:22:13.972 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T21:22:13.972 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-14T21:22:13.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/cluster1-0 2024-09-14T21:22:14.028 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:14.029 INFO:tasks.ceph:role: cluster1.osd.0 2024-09-14T21:22:14.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T21:22:14.029 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:14.091 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:14.494 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-14T21:22:14.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-14T21:22:14.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster1-0 2024-09-14T21:22:14.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-0 2024-09-14T21:22:14.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/cluster1-1 2024-09-14T21:22:14.761 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:14.761 INFO:tasks.ceph:role: cluster1.osd.1 2024-09-14T21:22:14.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T21:22:14.761 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:14.824 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:14.824 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:14.824 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:15.180 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-14T21:22:15.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-14T21:22:15.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster1-1 2024-09-14T21:22:15.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-1 2024-09-14T21:22:15.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/cluster1-2 2024-09-14T21:22:15.386 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:15.386 INFO:tasks.ceph:role: cluster1.osd.2 2024-09-14T21:22:15.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T21:22:15.386 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T21:22:15.449 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:15.450 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:15.834 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-14T21:22:15.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-14T21:22:15.837 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster1-2 2024-09-14T21:22:15.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-2 2024-09-14T21:22:16.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:16.096+0000 7fcde8e26640 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-0/keyring: can't open /var/lib/ceph/osd/cluster1-0/keyring: (2) No such file or directory 2024-09-14T21:22:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:16.097+0000 7fcde8e26640 -1 created new key in keyring /var/lib/ceph/osd/cluster1-0/keyring 2024-09-14T21:22:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:16.097+0000 7fcde8e26640 -1 bdev(0x55e20917d800 /var/lib/ceph/osd/cluster1-0/block) open stat got: (1) Operation not permitted 2024-09-14T21:22:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:16.097+0000 7fcde8e26640 -1 bluestore(/var/lib/ceph/osd/cluster1-0) _read_fsid unparsable uuid 2024-09-14T21:22:19.125 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-0 2024-09-14T21:22:19.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:19.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:19.278+0000 7f221154d640 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-1/keyring: can't open /var/lib/ceph/osd/cluster1-1/keyring: (2) No such file or directory 2024-09-14T21:22:19.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:19.279+0000 7f221154d640 -1 created new key in keyring /var/lib/ceph/osd/cluster1-1/keyring 2024-09-14T21:22:19.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:19.279+0000 7f221154d640 -1 bdev(0x55741dbbd800 /var/lib/ceph/osd/cluster1-1/block) open stat got: (1) Operation not permitted 2024-09-14T21:22:19.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:19.279+0000 7f221154d640 -1 bluestore(/var/lib/ceph/osd/cluster1-1) _read_fsid unparsable uuid 2024-09-14T21:22:22.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-1 2024-09-14T21:22:22.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:22.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:22.450+0000 7f2a8b80d640 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-2/keyring: can't open /var/lib/ceph/osd/cluster1-2/keyring: (2) No such file or directory 2024-09-14T21:22:22.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:22.451+0000 7f2a8b80d640 -1 created new key in keyring /var/lib/ceph/osd/cluster1-2/keyring 2024-09-14T21:22:22.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:22.451+0000 7f2a8b80d640 -1 bdev(0x564d94393800 /var/lib/ceph/osd/cluster1-2/block) open stat got: (1) Operation not permitted 2024-09-14T21:22:22.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-14T21:22:22.451+0000 7f2a8b80d640 -1 bluestore(/var/lib/ceph/osd/cluster1-2) _read_fsid unparsable uuid 2024-09-14T21:22:25.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-2 2024-09-14T21:22:25.508 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T21:22:25.508 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:25.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/cluster1-x/keyring of=/dev/stdout 2024-09-14T21:22:25.564 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:25.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-0/keyring of=/dev/stdout 2024-09-14T21:22:25.659 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:25.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-1/keyring of=/dev/stdout 2024-09-14T21:22:25.754 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:25.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-2/keyring of=/dev/stdout 2024-09-14T21:22:25.849 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:25.849 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/cluster1.client.mirror.keyring of=/dev/stdout 2024-09-14T21:22:25.889 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:25.889 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/cluster1.client.mirror.0.keyring of=/dev/stdout 2024-09-14T21:22:25.968 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T21:22:25.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/cluster1.keyring 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCF/uVmZfGrKxAAbWa6DN6ZTfETPGb3kkiXiQ== 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCI/uVm7evKBRAAIUgqoZd2273WTFo7c3DswA== 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCL/uVm36mjEBAALNahRfNVjh0ChZ1qe6HXbw== 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCO/uVmfp3tGhAAs0x4DjAt5mwD3OtoiumBkQ== 2024-09-14T21:22:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:[client.mirror] 2024-09-14T21:22:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCF/uVmggC6MRAAO59sbSaw6cMr8kWYdgFTLg== 2024-09-14T21:22:26.022 INFO:teuthology.orchestra.run.smithi063.stdout:[client.mirror.0] 2024-09-14T21:22:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCF/uVmhUxAOBAAD5piwdvU8XBepnRLw7BDow== 2024-09-14T21:22:26.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T21:22:26.158 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:22:26.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:22:26.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:22:26.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T21:22:26.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T21:22:26.637 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T21:22:26.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/cluster1-a 2024-09-14T21:22:26.693 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster1 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster1.monmap --keyring /etc/ceph/cluster1.keyring 2024-09-14T21:22:26.802 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster1-a 2024-09-14T21:22:26.858 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/cluster1.monmap 2024-09-14T21:22:26.893 INFO:tasks.ceph:Starting mon daemons in cluster cluster1... 2024-09-14T21:22:26.893 INFO:tasks.ceph.cluster1.mon.a:Restarting daemon 2024-09-14T21:22:26.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster1 -i a 2024-09-14T21:22:26.937 INFO:tasks.ceph.cluster1.mon.a:Started 2024-09-14T21:22:26.937 INFO:tasks.ceph:Starting mgr daemons in cluster cluster1... 2024-09-14T21:22:26.937 INFO:tasks.ceph.cluster1.mgr.x:Restarting daemon 2024-09-14T21:22:26.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster1 -i x 2024-09-14T21:22:26.941 INFO:tasks.ceph.cluster1.mgr.x:Started 2024-09-14T21:22:26.941 DEBUG:tasks.ceph:set 0 configs 2024-09-14T21:22:26.941 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T21:22:26.941 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 osd crush tunables default 2024-09-14T21:22:27.173 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-14T21:22:27.188 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T21:22:27.188 INFO:tasks.ceph:Starting osd daemons in cluster cluster1... 2024-09-14T21:22:27.189 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:27.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-0/fsid of=/dev/stdout 2024-09-14T21:22:27.245 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:27.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-1/fsid of=/dev/stdout 2024-09-14T21:22:27.341 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:27.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/cluster1-2/fsid of=/dev/stdout 2024-09-14T21:22:27.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 osd new 617183d8-d16e-4af2-8ace-d92b5a6cfa71 0 2024-09-14T21:22:27.718 INFO:teuthology.orchestra.run.smithi063.stdout:0 2024-09-14T21:22:27.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 osd new 5dc414c5-c4f8-49f7-8dc7-dcac0d34a840 1 2024-09-14T21:22:27.972 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-14T21:22:27.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 osd new 1f79ab3f-f676-489c-b6a7-523a035ef95d 2 2024-09-14T21:22:28.225 INFO:teuthology.orchestra.run.smithi063.stdout:2 2024-09-14T21:22:28.241 INFO:tasks.ceph.cluster1.osd.0:Restarting daemon 2024-09-14T21:22:28.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 2024-09-14T21:22:28.244 INFO:tasks.ceph.cluster1.osd.0:Started 2024-09-14T21:22:28.245 INFO:tasks.ceph.cluster1.osd.1:Restarting daemon 2024-09-14T21:22:28.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 2024-09-14T21:22:28.249 INFO:tasks.ceph.cluster1.osd.1:Started 2024-09-14T21:22:28.249 INFO:tasks.ceph.cluster1.osd.2:Restarting daemon 2024-09-14T21:22:28.249 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 2024-09-14T21:22:28.253 INFO:tasks.ceph.cluster1.osd.2:Started 2024-09-14T21:22:28.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:28.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:28.497 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:28.223419+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:28.513 INFO:tasks.ceph.ceph_manager.cluster1:[] 2024-09-14T21:22:28.513 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T21:22:28.816 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:29.028 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-14T21:22:29.028 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":5,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:28.223419+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:29.041 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-14T21:22:29.808 INFO:tasks.ceph.cluster1.osd.1.smithi063.stderr:2024-09-14T21:22:29.806+0000 7fbd88642640 -1 Falling back to public interface 2024-09-14T21:22:29.813 INFO:tasks.ceph.cluster1.osd.2.smithi063.stderr:2024-09-14T21:22:29.811+0000 7f5e1d945640 -1 Falling back to public interface 2024-09-14T21:22:29.814 INFO:tasks.ceph.cluster1.osd.0.smithi063.stderr:2024-09-14T21:22:29.811+0000 7fd93460d640 -1 Falling back to public interface 2024-09-14T21:22:33.382 INFO:tasks.ceph.cluster1.mgr.x.smithi063.stderr:2024-09-14T21:22:33.379+0000 7f7642400640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-14T21:22:33.724 INFO:tasks.ceph.cluster1.osd.1.smithi063.stderr:2024-09-14T21:22:33.721+0000 7fbd88642640 -1 osd.1 0 log_to_monitors true 2024-09-14T21:22:33.994 INFO:tasks.ceph.cluster1.osd.2.smithi063.stderr:2024-09-14T21:22:33.991+0000 7f5e1d945640 -1 osd.2 0 log_to_monitors true 2024-09-14T21:22:34.015 INFO:tasks.ceph.cluster1.osd.0.smithi063.stderr:2024-09-14T21:22:34.013+0000 7fd93460d640 -1 osd.0 0 log_to_monitors true 2024-09-14T21:22:35.345 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:35.786 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-14T21:22:35.786 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":7,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:35.377154+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:35.803 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-14T21:22:37.249 INFO:tasks.ceph.cluster1.osd.0.smithi063.stderr:2024-09-14T21:22:37.247+0000 7fd92f000640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T21:22:37.254 INFO:tasks.ceph.cluster1.osd.0.smithi063.stderr:2024-09-14T21:22:37.252+0000 7fd925000640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:22:37.259 INFO:tasks.ceph.cluster1.osd.2.smithi063.stderr:2024-09-14T21:22:37.257+0000 7f5e18800640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T21:22:37.263 INFO:tasks.ceph.cluster1.osd.2.smithi063.stderr:2024-09-14T21:22:37.261+0000 7f5e0e800640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:22:37.273 INFO:tasks.ceph.cluster1.osd.1.smithi063.stderr:2024-09-14T21:22:37.271+0000 7fbd83e00640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T21:22:37.289 INFO:tasks.ceph.cluster1.osd.1.smithi063.stderr:2024-09-14T21:22:37.287+0000 7fbd79400640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:22:42.106 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:42.462 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-14T21:22:42.462 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":11,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:41.253525+0000","last_up_change":"2024-09-14T21:22:38.244211+0000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:22:38.403379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6813","nonce":1669524686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6817","nonce":1669524686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6823","nonce":1669524686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6820","nonce":1669524686}]},"public_addr":"172.21.15.63:6813/1669524686","cluster_addr":"172.21.15.63:6817/1669524686","heartbeat_back_addr":"172.21.15.63:6823/1669524686","heartbeat_front_addr":"172.21.15.63:6820/1669524686","state":["exists","up"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6801","nonce":2907331463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6803","nonce":2907331463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6807","nonce":2907331463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6805","nonce":2907331463}]},"public_addr":"172.21.15.63:6801/2907331463","cluster_addr":"172.21.15.63:6803/2907331463","heartbeat_back_addr":"172.21.15.63:6807/2907331463","heartbeat_front_addr":"172.21.15.63:6805/2907331463","state":["exists","up"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6809","nonce":2572181379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6812","nonce":2572181379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6821","nonce":2572181379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6816","nonce":2572181379}]},"public_addr":"172.21.15.63:6809/2572181379","cluster_addr":"172.21.15.63:6812/2572181379","heartbeat_back_addr":"172.21.15.63:6821/2572181379","heartbeat_front_addr":"172.21.15.63:6816/2572181379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.981624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.685698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.964714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:42.476 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-14T21:22:42.476 INFO:tasks.ceph:Creating RBD pool 2024-09-14T21:22:42.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 osd pool create rbd 8 2024-09-14T21:22:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2024-09-14T21:22:43.294 DEBUG:teuthology.orchestra.run.smithi063:> rbd --cluster cluster1 pool init rbd 2024-09-14T21:22:46.310 INFO:tasks.ceph:Starting mds daemons in cluster cluster1... 2024-09-14T21:22:46.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 config log 1 --format=json 2024-09-14T21:22:46.311 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T21:22:46.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:46.699 INFO:teuthology.orchestra.run.smithi063.stdout:[{"version":4,"timestamp":"2024-09-14T21:22:37.273004+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"4391.798434"}]}] 2024-09-14T21:22:46.700 INFO:tasks.ceph_manager:config epoch is 4 2024-09-14T21:22:46.700 INFO:tasks.ceph:Waiting until cluster1 daemons up and pgs clean... 2024-09-14T21:22:46.700 INFO:tasks.ceph.ceph_manager.cluster1:waiting for mgr available 2024-09-14T21:22:46.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 mgr dump --format=json 2024-09-14T21:22:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:47.133 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2418753557},{"type":"v1","addr":"172.21.15.63:6825","nonce":2418753557}]},"active_addr":"172.21.15.63:6825/2418753557","active_change":"2024-09-14T21:22:32.371932+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1728991315}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":2768782732}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3679953244}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3218953921}]}]} 2024-09-14T21:22:47.136 INFO:tasks.ceph.ceph_manager.cluster1:mgr available! 2024-09-14T21:22:47.136 INFO:tasks.ceph.ceph_manager.cluster1:waiting for all up 2024-09-14T21:22:47.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:47.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:47.497 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:46.280031+0000","last_up_change":"2024-09-14T21:22:38.244211+0000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:22:38.403379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:22:42.840815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6813","nonce":1669524686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6817","nonce":1669524686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6823","nonce":1669524686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6820","nonce":1669524686}]},"public_addr":"172.21.15.63:6813/1669524686","cluster_addr":"172.21.15.63:6817/1669524686","heartbeat_back_addr":"172.21.15.63:6823/1669524686","heartbeat_front_addr":"172.21.15.63:6820/1669524686","state":["exists","up"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6801","nonce":2907331463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6803","nonce":2907331463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6807","nonce":2907331463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6805","nonce":2907331463}]},"public_addr":"172.21.15.63:6801/2907331463","cluster_addr":"172.21.15.63:6803/2907331463","heartbeat_back_addr":"172.21.15.63:6807/2907331463","heartbeat_front_addr":"172.21.15.63:6805/2907331463","state":["exists","up"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6809","nonce":2572181379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6812","nonce":2572181379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6821","nonce":2572181379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6816","nonce":2572181379}]},"public_addr":"172.21.15.63:6809/2572181379","cluster_addr":"172.21.15.63:6812/2572181379","heartbeat_back_addr":"172.21.15.63:6821/2572181379","heartbeat_front_addr":"172.21.15.63:6816/2572181379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.981624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.685698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.964714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:47.515 INFO:tasks.ceph.ceph_manager.cluster1:all up! 2024-09-14T21:22:47.515 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-14T21:22:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:47.876 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T21:22:46.280031+0000","last_up_change":"2024-09-14T21:22:38.244211+0000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:22:38.403379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:22:42.840815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6813","nonce":1669524686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6817","nonce":1669524686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6823","nonce":1669524686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6820","nonce":1669524686}]},"public_addr":"172.21.15.63:6813/1669524686","cluster_addr":"172.21.15.63:6817/1669524686","heartbeat_back_addr":"172.21.15.63:6823/1669524686","heartbeat_front_addr":"172.21.15.63:6820/1669524686","state":["exists","up"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6801","nonce":2907331463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6803","nonce":2907331463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6807","nonce":2907331463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6805","nonce":2907331463}]},"public_addr":"172.21.15.63:6801/2907331463","cluster_addr":"172.21.15.63:6803/2907331463","heartbeat_back_addr":"172.21.15.63:6807/2907331463","heartbeat_front_addr":"172.21.15.63:6805/2907331463","state":["exists","up"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6809","nonce":2572181379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6812","nonce":2572181379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6821","nonce":2572181379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6816","nonce":2572181379}]},"public_addr":"172.21.15.63:6809/2572181379","cluster_addr":"172.21.15.63:6812/2572181379","heartbeat_back_addr":"172.21.15.63:6821/2572181379","heartbeat_front_addr":"172.21.15.63:6816/2572181379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.981624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.685698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.964714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:22:47.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 flush_pg_stats 2024-09-14T21:22:47.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 flush_pg_stats 2024-09-14T21:22:47.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 flush_pg_stats 2024-09-14T21:22:48.102 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:48.103 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2024-09-14T21:22:48.119 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:48.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2024-09-14T21:22:48.120 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:48.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2024-09-14T21:22:48.477 INFO:teuthology.orchestra.run.smithi063.stdout:34359738372 2024-09-14T21:22:48.495 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738372 for osd.2 2024-09-14T21:22:48.543 INFO:teuthology.orchestra.run.smithi063.stdout:34359738372 2024-09-14T21:22:48.543 INFO:teuthology.orchestra.run.smithi063.stdout:34359738372 2024-09-14T21:22:48.561 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738372 for osd.1 2024-09-14T21:22:48.562 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738372 for osd.0 2024-09-14T21:22:49.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2024-09-14T21:22:49.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2024-09-14T21:22:49.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2024-09-14T21:22:49.890 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:49.910 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738373 for osd.2 2024-09-14T21:22:49.910 DEBUG:teuthology.parallel:result is None 2024-09-14T21:22:49.943 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:49.953 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-14T21:22:49.962 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738373 for osd.1 2024-09-14T21:22:49.962 DEBUG:teuthology.parallel:result is None 2024-09-14T21:22:49.971 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738373 for osd.0 2024-09-14T21:22:49.972 DEBUG:teuthology.parallel:result is None 2024-09-14T21:22:49.972 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2024-09-14T21:22:49.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T21:22:50.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T21:22:50.388 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-14T21:22:48.382112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1552,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1589248,"data_stored":1295959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82963797},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.108729"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294012+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T21:22:46.294012+0000","last_peered":"2024-09-14T21:22:46.294012+0000","last_clean":"2024-09-14T21:22:46.294012+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T21:22:46.294012+0000","last_undegraded":"2024-09-14T21:22:46.294012+0000","last_fullsized":"2024-09-14T21:22:46.294012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294382+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T21:22:46.294382+0000","last_peered":"2024-09-14T21:22:46.294382+0000","last_clean":"2024-09-14T21:22:46.294382+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T21:22:46.294382+0000","last_undegraded":"2024-09-14T21:22:46.294382+0000","last_fullsized":"2024-09-14T21:22:46.294382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.293731+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T21:22:46.293731+0000","last_peered":"2024-09-14T21:22:46.293731+0000","last_clean":"2024-09-14T21:22:46.293731+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T21:22:46.293731+0000","last_undegraded":"2024-09-14T21:22:46.293731+0000","last_fullsized":"2024-09-14T21:22:46.293731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294075+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T21:22:46.294075+0000","last_peered":"2024-09-14T21:22:46.294075+0000","last_clean":"2024-09-14T21:22:46.294075+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T21:22:46.294075+0000","last_undegraded":"2024-09-14T21:22:46.294075+0000","last_fullsized":"2024-09-14T21:22:46.294075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.286321+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T21:22:46.286321+0000","last_peered":"2024-09-14T21:22:46.286321+0000","last_clean":"2024-09-14T21:22:46.286321+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T21:22:46.286321+0000","last_undegraded":"2024-09-14T21:22:46.286321+0000","last_fullsized":"2024-09-14T21:22:46.286321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.920607+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T21:22:46.920607+0000","last_peered":"2024-09-14T21:22:46.920607+0000","last_clean":"2024-09-14T21:22:46.920607+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T21:22:46.920607+0000","last_undegraded":"2024-09-14T21:22:46.920607+0000","last_fullsized":"2024-09-14T21:22:46.920607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.920658+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T21:22:46.920658+0000","last_peered":"2024-09-14T21:22:46.920658+0000","last_clean":"2024-09-14T21:22:46.920658+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T21:22:46.920658+0000","last_undegraded":"2024-09-14T21:22:46.920658+0000","last_fullsized":"2024-09-14T21:22:46.920658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.293665+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T21:22:46.293665+0000","last_peered":"2024-09-14T21:22:46.293665+0000","last_clean":"2024-09-14T21:22:46.293665+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T21:22:46.293665+0000","last_undegraded":"2024-09-14T21:22:46.293665+0000","last_fullsized":"2024-09-14T21:22:46.293665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.292941+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T21:22:46.292941+0000","last_peered":"2024-09-14T21:22:46.292941+0000","last_clean":"2024-09-14T21:22:46.292941+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T21:22:46.292941+0000","last_undegraded":"2024-09-14T21:22:46.292941+0000","last_fullsized":"2024-09-14T21:22:46.292941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":38395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T21:22:50.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T21:22:50.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:50.748 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T21:22:50.765 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-14T21:22:50.382388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1552,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1589248,"data_stored":1295959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82963797},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.109005"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294012+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T21:22:46.294012+0000","last_peered":"2024-09-14T21:22:46.294012+0000","last_clean":"2024-09-14T21:22:46.294012+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T21:22:46.294012+0000","last_undegraded":"2024-09-14T21:22:46.294012+0000","last_fullsized":"2024-09-14T21:22:46.294012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294382+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T21:22:46.294382+0000","last_peered":"2024-09-14T21:22:46.294382+0000","last_clean":"2024-09-14T21:22:46.294382+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T21:22:46.294382+0000","last_undegraded":"2024-09-14T21:22:46.294382+0000","last_fullsized":"2024-09-14T21:22:46.294382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.293731+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T21:22:46.293731+0000","last_peered":"2024-09-14T21:22:46.293731+0000","last_clean":"2024-09-14T21:22:46.293731+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T21:22:46.293731+0000","last_undegraded":"2024-09-14T21:22:46.293731+0000","last_fullsized":"2024-09-14T21:22:46.293731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.294075+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T21:22:46.294075+0000","last_peered":"2024-09-14T21:22:46.294075+0000","last_clean":"2024-09-14T21:22:46.294075+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T21:22:46.294075+0000","last_undegraded":"2024-09-14T21:22:46.294075+0000","last_fullsized":"2024-09-14T21:22:46.294075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.286321+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T21:22:46.286321+0000","last_peered":"2024-09-14T21:22:46.286321+0000","last_clean":"2024-09-14T21:22:46.286321+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T21:22:46.286321+0000","last_undegraded":"2024-09-14T21:22:46.286321+0000","last_fullsized":"2024-09-14T21:22:46.286321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.920607+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T21:22:46.920607+0000","last_peered":"2024-09-14T21:22:46.920607+0000","last_clean":"2024-09-14T21:22:46.920607+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T21:22:46.920607+0000","last_undegraded":"2024-09-14T21:22:46.920607+0000","last_fullsized":"2024-09-14T21:22:46.920607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.920658+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T21:22:46.920658+0000","last_peered":"2024-09-14T21:22:46.920658+0000","last_clean":"2024-09-14T21:22:46.920658+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T21:22:46.920658+0000","last_undegraded":"2024-09-14T21:22:46.920658+0000","last_fullsized":"2024-09-14T21:22:46.920658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.293665+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T21:22:46.293665+0000","last_peered":"2024-09-14T21:22:46.293665+0000","last_clean":"2024-09-14T21:22:46.293665+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T21:22:46.293665+0000","last_undegraded":"2024-09-14T21:22:46.293665+0000","last_fullsized":"2024-09-14T21:22:46.293665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:22:46.292941+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T21:22:46.292941+0000","last_peered":"2024-09-14T21:22:46.292941+0000","last_clean":"2024-09-14T21:22:46.292941+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T21:22:46.292941+0000","last_undegraded":"2024-09-14T21:22:46.292941+0000","last_fullsized":"2024-09-14T21:22:46.292941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":38395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T21:22:50.767 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2024-09-14T21:22:50.767 INFO:tasks.ceph:Waiting until ceph cluster cluster1 is healthy... 2024-09-14T21:22:50.767 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy 2024-09-14T21:22:50.768 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 health --format=json 2024-09-14T21:22:51.168 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:51.168 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T21:22:51.186 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy done 2024-09-14T21:22:51.186 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T21:22:51.199 INFO:tasks.ceph:Creating ceph cluster cluster2... 2024-09-14T21:22:51.199 INFO:tasks.ceph:config {'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'cluster2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T21:22:51.199 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598', 'branch': 'main', 'description': 'krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{legacy} tasks/compare-mirror-images}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904598', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': '2 ceph clusters with 1 mon, 1 mgr and 3 osd each'}], 'name': 'teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}, 'extra_system_packages': ['pv']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2'], ['cluster2.mon.a', 'cluster2.mgr.x', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster2.client.mirror', 'cluster2.client.mirror.0']], 'seed': 8145, 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'krbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_711c10c3b606220cc536e8cfed3eb9d03ecd33d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdDtSlVWGp9Vj2qzHuL58OVrpq3fzHe/2RVQK/fgVZn64i26CHL6650A+11TNPKW+2jiNWTo2aKDSlc9AkB49w=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3JpJXPmEtDM2SWMCJoeLVs37Pm9b51micdFDljVDo8cuFytRuis/x7K/cICcGqkvDBu+5JC8TJ84OMczgdnhM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1', 'extra_system_packages': ['pv']}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}}, {'ceph': {'cluster': 'cluster2', 'conf': {'client': {'rbd default map options': 'ms_mode=legacy'}, 'global': {'mon warn on pool no app': False, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': False}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': False}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/compare_mirror_images.sh']}, 'env': {'RBD_DEVICE_TYPE': 'krbd', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '3h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-14_20:48:16', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T21:22:51.200 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2024-09-14T21:22:51.204 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2024-09-14T21:22:51.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T21:22:51.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T21:22:51.342 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:51.343 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T21:22:51.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T21:22:51.379 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-14 21:22:01.978498958 +0000 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-14 21:18:36.566935972 +0000 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-14 21:18:36.566935972 +0000 2024-09-14T21:22:51.454 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-14 21:18:36.566935972 +0000 2024-09-14T21:22:51.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T21:22:51.547 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-14T21:22:51.547 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-14T21:22:51.547 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000280507 s, 1.8 MB/s 2024-09-14T21:22:51.549 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T21:22:51.586 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-14 21:22:01.979498937 +0000 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-14 21:18:37.061925000 +0000 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-14 21:18:37.061925000 +0000 2024-09-14T21:22:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-14 21:18:37.061925000 +0000 2024-09-14T21:22:51.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T21:22:51.760 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-14T21:22:51.760 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-14T21:22:51.760 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000289277 s, 1.8 MB/s 2024-09-14T21:22:51.763 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T21:22:51.799 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-14 21:22:01.979498937 +0000 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-14 21:18:37.532914560 +0000 2024-09-14T21:22:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-14 21:18:37.532914560 +0000 2024-09-14T21:22:51.877 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-14 21:18:37.532914560 +0000 2024-09-14T21:22:51.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T21:22:51.970 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-14T21:22:51.970 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-14T21:22:51.970 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000291781 s, 1.8 MB/s 2024-09-14T21:22:51.973 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T21:22:52.009 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-14T21:22:52.085 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-14 21:22:01.980498914 +0000 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-14 21:18:38.005904076 +0000 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-14 21:18:38.005904076 +0000 2024-09-14T21:22:52.086 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-14 21:18:38.005904076 +0000 2024-09-14T21:22:52.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T21:22:52.179 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-14T21:22:52.179 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-14T21:22:52.179 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000293892 s, 1.7 MB/s 2024-09-14T21:22:52.184 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T21:22:52.221 INFO:tasks.ceph:osd dev map: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:52.222 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-14T21:22:52.222 INFO:tasks.ceph:Generating config... 2024-09-14T21:22:52.223 INFO:tasks.ceph:[client] rbd default map options = ms_mode=legacy 2024-09-14T21:22:52.223 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T21:22:52.223 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-14T21:22:52.223 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T21:22:52.223 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T21:22:52.223 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T21:22:52.223 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T21:22:52.223 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T21:22:52.223 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T21:22:52.224 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T21:22:52.224 INFO:tasks.ceph:Setting up cluster2.mon.a... 2024-09-14T21:22:52.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster2.keyring 2024-09-14T21:22:52.343 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/cluster2.keyring 2024-09-14T21:22:52.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster2.keyring 2024-09-14T21:22:52.434 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-14T21:22:52.491 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster2.mon.a', '172.21.15.169')] 2024-09-14T21:22:52.491 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.169', 'mon warn on pool no app': False, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default map options': 'ms_mode=legacy'}, 'mon.a': {}} 2024-09-14T21:22:52.492 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:52.492 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T21:22:52.527 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.169 --print /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:52.639 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:52.639 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: generated fsid 1e662d65-333f-4d02-8c8e-27508b0b0848 2024-09-14T21:22:52.639 INFO:teuthology.orchestra.run.smithi169.stdout:setting min_mon_release = quincy 2024-09-14T21:22:52.639 INFO:teuthology.orchestra.run.smithi169.stdout:epoch 0 2024-09-14T21:22:52.639 INFO:teuthology.orchestra.run.smithi169.stdout:fsid 1e662d65-333f-4d02-8c8e-27508b0b0848 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:last_changed 2024-09-14T21:22:52.638052+0000 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:created 2024-09-14T21:22:52.638052+0000 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:min_mon_release 17 (quincy) 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:election_strategy: 1 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:0: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.a 2024-09-14T21:22:52.640 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster2.monmap (1 monitors) 2024-09-14T21:22:52.642 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T21:22:52.677 INFO:tasks.ceph:Writing /etc/ceph/cluster2.conf for FSID 1e662d65-333f-4d02-8c8e-27508b0b0848... 2024-09-14T21:22:52.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2024-09-14T21:22:52.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.786 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T21:22:52.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.788 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = 172.21.15.169 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on pool no app = False 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 1e662d65-333f-4d02-8c8e-27508b0b0848 2024-09-14T21:22:52.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-14T21:22:52.790 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.791 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-14T21:22:52.792 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:52.793 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T21:22:52.794 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-14T21:22:52.795 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-14T21:22:52.796 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-14T21:22:52.796 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T21:22:52.796 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T21:22:52.796 INFO:teuthology.orchestra.run.smithi063.stdout: rbd default map options = ms_mode=legacy 2024-09-14T21:22:52.796 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-14T21:22:52.815 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-14T21:22:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-14T21:22:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-14T21:22:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-14T21:22:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = 172.21.15.169 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1e662d65-333f-4d02-8c8e-27508b0b0848 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-14T21:22:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-09-14T21:22:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-14T21:22:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: rbd default map options = ms_mode=legacy 2024-09-14T21:22:52.825 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-14T21:22:52.841 INFO:tasks.ceph:Creating admin key on cluster2.mon.a... 2024-09-14T21:22:52.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster2.keyring 2024-09-14T21:22:52.939 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T21:22:52.939 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:52.939 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/cluster2.keyring of=/dev/stdout 2024-09-14T21:22:52.973 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:52.974 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/home/ubuntu/cephtest/cluster2.monmap of=/dev/stdout 2024-09-14T21:22:53.049 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T21:22:53.049 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:53.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/cluster2.keyring 2024-09-14T21:22:53.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-14T21:22:53.129 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-14T21:22:53.129 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:53.204 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T21:22:53.204 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:53.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/cluster2.keyring 2024-09-14T21:22:53.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-14T21:22:53.284 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:22:53.284 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:53.360 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T21:22:53.360 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T21:22:53.360 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/cluster2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster2-x/keyring 2024-09-14T21:22:53.504 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/cluster2-x/keyring 2024-09-14T21:22:53.510 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T21:22:53.510 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T21:22:53.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster2.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.keyring 2024-09-14T21:22:53.591 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/cluster2.client.mirror.keyring 2024-09-14T21:22:53.618 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster2.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.0.keyring 2024-09-14T21:22:53.699 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/cluster2.client.mirror.0.keyring 2024-09-14T21:22:53.726 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T21:22:53.726 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-14T21:22:53.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/cluster2-0 2024-09-14T21:22:53.782 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:53.782 INFO:tasks.ceph:role: cluster2.osd.0 2024-09-14T21:22:53.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T21:22:53.782 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:53.845 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:53.846 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:53.846 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:53.846 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:54.253 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-14T21:22:54.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-14T21:22:54.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster2-0 2024-09-14T21:22:54.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-0 2024-09-14T21:22:54.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/cluster2-1 2024-09-14T21:22:54.497 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:54.498 INFO:tasks.ceph:role: cluster2.osd.1 2024-09-14T21:22:54.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T21:22:54.498 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T21:22:54.560 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:54.560 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:54.561 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:54.921 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-14T21:22:54.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-14T21:22:54.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster2-1 2024-09-14T21:22:55.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-1 2024-09-14T21:22:55.069 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/cluster2-2 2024-09-14T21:22:55.125 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T21:22:55.125 INFO:tasks.ceph:role: cluster2.osd.2 2024-09-14T21:22:55.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T21:22:55.126 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T21:22:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T21:22:55.189 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T21:22:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T21:22:55.191 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T21:22:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T21:22:55.580 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-14T21:22:55.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-14T21:22:55.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster2-2 2024-09-14T21:22:55.685 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-2 2024-09-14T21:22:55.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:55.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:55.841+0000 7fd8c0c13640 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-0/keyring: can't open /var/lib/ceph/osd/cluster2-0/keyring: (2) No such file or directory 2024-09-14T21:22:55.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:55.841+0000 7fd8c0c13640 -1 created new key in keyring /var/lib/ceph/osd/cluster2-0/keyring 2024-09-14T21:22:55.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:55.841+0000 7fd8c0c13640 -1 bdev(0x555edbb23800 /var/lib/ceph/osd/cluster2-0/block) open stat got: (1) Operation not permitted 2024-09-14T21:22:55.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:55.841+0000 7fd8c0c13640 -1 bluestore(/var/lib/ceph/osd/cluster2-0) _read_fsid unparsable uuid 2024-09-14T21:22:58.881 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-0 2024-09-14T21:22:58.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:22:59.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:59.026+0000 7face1415640 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-1/keyring: can't open /var/lib/ceph/osd/cluster2-1/keyring: (2) No such file or directory 2024-09-14T21:22:59.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:59.026+0000 7face1415640 -1 created new key in keyring /var/lib/ceph/osd/cluster2-1/keyring 2024-09-14T21:22:59.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:59.026+0000 7face1415640 -1 bdev(0x55566d3b9800 /var/lib/ceph/osd/cluster2-1/block) open stat got: (1) Operation not permitted 2024-09-14T21:22:59.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:22:59.027+0000 7face1415640 -1 bluestore(/var/lib/ceph/osd/cluster2-1) _read_fsid unparsable uuid 2024-09-14T21:23:02.107 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-1 2024-09-14T21:23:02.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:23:02.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:23:02.252+0000 7ff1dc487640 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-2/keyring: can't open /var/lib/ceph/osd/cluster2-2/keyring: (2) No such file or directory 2024-09-14T21:23:02.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:23:02.252+0000 7ff1dc487640 -1 created new key in keyring /var/lib/ceph/osd/cluster2-2/keyring 2024-09-14T21:23:02.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:23:02.252+0000 7ff1dc487640 -1 bdev(0x55bf26285800 /var/lib/ceph/osd/cluster2-2/block) open stat got: (1) Operation not permitted 2024-09-14T21:23:02.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-14T21:23:02.253+0000 7ff1dc487640 -1 bluestore(/var/lib/ceph/osd/cluster2-2) _read_fsid unparsable uuid 2024-09-14T21:23:05.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-2 2024-09-14T21:23:05.585 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T21:23:05.586 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:05.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/cluster2-x/keyring of=/dev/stdout 2024-09-14T21:23:05.640 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:05.641 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-0/keyring of=/dev/stdout 2024-09-14T21:23:05.736 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:05.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-1/keyring of=/dev/stdout 2024-09-14T21:23:05.831 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:05.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-2/keyring of=/dev/stdout 2024-09-14T21:23:05.928 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:05.928 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/cluster2.client.mirror.keyring of=/dev/stdout 2024-09-14T21:23:06.003 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:06.003 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/cluster2.client.mirror.0.keyring of=/dev/stdout 2024-09-14T21:23:06.079 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T21:23:06.079 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/cluster2.keyring 2024-09-14T21:23:06.171 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCt/uVmRu//HRAAX0mFgM7xhsfoICMb4xXU9A== 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCv/uVm6hI1MhAAFXe8UjWy+wtg9WoXZrezjA== 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCz/uVmkHGgARAAC4rIRlpk7ygMQuOjst1M/g== 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQC2/uVml1kMDxAAV724j2pXrwNlQexzvJspfA== 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:[client.mirror] 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCt/uVmPWIuIxAAqqjWXYtYuW0XhzUeWyrsSg== 2024-09-14T21:23:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:[client.mirror.0] 2024-09-14T21:23:06.173 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCt/uVmy9KaKRAA6Ulc40CBHGHLjr69B9VN5Q== 2024-09-14T21:23:06.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T21:23:06.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:23:06.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:23:06.495 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T21:23:06.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T21:23:06.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T21:23:06.782 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T21:23:06.782 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/cluster2-a 2024-09-14T21:23:06.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster2 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster2.monmap --keyring /etc/ceph/cluster2.keyring 2024-09-14T21:23:06.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster2-a 2024-09-14T21:23:07.003 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/cluster2.monmap 2024-09-14T21:23:07.037 INFO:tasks.ceph:Starting mon daemons in cluster cluster2... 2024-09-14T21:23:07.037 INFO:tasks.ceph.cluster2.mon.a:Restarting daemon 2024-09-14T21:23:07.038 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster2 -i a 2024-09-14T21:23:07.081 INFO:tasks.ceph.cluster2.mon.a:Started 2024-09-14T21:23:07.081 INFO:tasks.ceph:Starting mgr daemons in cluster cluster2... 2024-09-14T21:23:07.081 INFO:tasks.ceph.cluster2.mgr.x:Restarting daemon 2024-09-14T21:23:07.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster2 -i x 2024-09-14T21:23:07.085 INFO:tasks.ceph.cluster2.mgr.x:Started 2024-09-14T21:23:07.085 DEBUG:tasks.ceph:set 0 configs 2024-09-14T21:23:07.085 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T21:23:07.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 osd crush tunables default 2024-09-14T21:23:07.317 INFO:teuthology.orchestra.run.smithi169.stderr:adjusted tunables profile to default 2024-09-14T21:23:07.333 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T21:23:07.333 INFO:tasks.ceph:Starting osd daemons in cluster cluster2... 2024-09-14T21:23:07.333 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:07.333 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-0/fsid of=/dev/stdout 2024-09-14T21:23:07.389 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:07.389 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-1/fsid of=/dev/stdout 2024-09-14T21:23:07.488 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:23:07.488 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/cluster2-2/fsid of=/dev/stdout 2024-09-14T21:23:07.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 osd new d79904d0-f442-4d8c-ba1a-169ae3cf0298 0 2024-09-14T21:23:07.858 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-09-14T21:23:07.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 osd new a38563c5-58c2-4df4-aabd-f6266917b2d0 1 2024-09-14T21:23:08.111 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-14T21:23:08.126 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 osd new 3834e4b1-776a-42be-a471-589e95ee253a 2 2024-09-14T21:23:08.359 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-09-14T21:23:08.375 INFO:tasks.ceph.cluster2.osd.0:Restarting daemon 2024-09-14T21:23:08.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 0 2024-09-14T21:23:08.379 INFO:tasks.ceph.cluster2.osd.0:Started 2024-09-14T21:23:08.379 INFO:tasks.ceph.cluster2.osd.1:Restarting daemon 2024-09-14T21:23:08.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 1 2024-09-14T21:23:08.382 INFO:tasks.ceph.cluster2.osd.1:Started 2024-09-14T21:23:08.383 INFO:tasks.ceph.cluster2.osd.2:Restarting daemon 2024-09-14T21:23:08.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 2024-09-14T21:23:08.386 INFO:tasks.ceph.cluster2.osd.2:Started 2024-09-14T21:23:08.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:08.676 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:08.677 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":5,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:08.357711+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:08.692 INFO:tasks.ceph.ceph_manager.cluster2:[] 2024-09-14T21:23:08.692 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T21:23:08.995 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:09.204 INFO:teuthology.misc.health.smithi169.stdout: 2024-09-14T21:23:09.204 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":5,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:08.357711+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:09.217 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-14T21:23:09.922 INFO:tasks.ceph.cluster2.osd.2.smithi169.stderr:2024-09-14T21:23:09.921+0000 7f56dc812640 -1 Falling back to public interface 2024-09-14T21:23:09.928 INFO:tasks.ceph.cluster2.osd.0.smithi169.stderr:2024-09-14T21:23:09.927+0000 7fcb8f60d640 -1 Falling back to public interface 2024-09-14T21:23:10.177 INFO:tasks.ceph.cluster2.osd.1.smithi169.stderr:2024-09-14T21:23:10.176+0000 7fe799632640 -1 Falling back to public interface 2024-09-14T21:23:13.331 INFO:tasks.ceph.cluster2.mgr.x.smithi169.stderr:2024-09-14T21:23:13.329+0000 7f6872a00640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-14T21:23:13.615 INFO:tasks.ceph.cluster2.osd.2.smithi169.stderr:2024-09-14T21:23:13.612+0000 7f56dc812640 -1 osd.2 0 log_to_monitors true 2024-09-14T21:23:14.033 INFO:tasks.ceph.cluster2.osd.1.smithi169.stderr:2024-09-14T21:23:14.031+0000 7fe799632640 -1 osd.1 0 log_to_monitors true 2024-09-14T21:23:14.174 INFO:tasks.ceph.cluster2.osd.0.smithi169.stderr:2024-09-14T21:23:14.171+0000 7fcb8f60d640 -1 osd.0 0 log_to_monitors true 2024-09-14T21:23:15.520 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:15.920 INFO:teuthology.misc.health.smithi169.stdout: 2024-09-14T21:23:15.920 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":7,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:15.328825+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:15.940 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-14T21:23:17.145 INFO:tasks.ceph.cluster2.osd.1.smithi169.stderr:2024-09-14T21:23:17.143+0000 7fe793a00640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T21:23:17.150 INFO:tasks.ceph.cluster2.osd.1.smithi169.stderr:2024-09-14T21:23:17.148+0000 7fe789a00640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:23:17.236 INFO:tasks.ceph.cluster2.osd.2.smithi169.stderr:2024-09-14T21:23:17.233+0000 7f56d7a00640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T21:23:17.242 INFO:tasks.ceph.cluster2.osd.2.smithi169.stderr:2024-09-14T21:23:17.240+0000 7f56cd000640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:23:17.260 INFO:tasks.ceph.cluster2.osd.0.smithi169.stderr:2024-09-14T21:23:17.258+0000 7fcb89e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T21:23:17.272 INFO:tasks.ceph.cluster2.osd.0.smithi169.stderr:2024-09-14T21:23:17.270+0000 7fcb7fe00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T21:23:22.242 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:22.585 INFO:teuthology.misc.health.smithi169.stdout: 2024-09-14T21:23:22.586 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":11,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:21.150582+0000","last_up_change":"2024-09-14T21:23:18.140776+0000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:23:18.350689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6809","nonce":1172764576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6811","nonce":1172764576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6815","nonce":1172764576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6813","nonce":1172764576}]},"public_addr":"172.21.15.169:6809/1172764576","cluster_addr":"172.21.15.169:6811/1172764576","heartbeat_back_addr":"172.21.15.169:6815/1172764576","heartbeat_front_addr":"172.21.15.169:6813/1172764576","state":["exists","up"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6817","nonce":1042050961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6819","nonce":1042050961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6823","nonce":1042050961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6821","nonce":1042050961}]},"public_addr":"172.21.15.169:6817/1042050961","cluster_addr":"172.21.15.169:6819/1042050961","heartbeat_back_addr":"172.21.15.169:6823/1042050961","heartbeat_front_addr":"172.21.15.169:6821/1042050961","state":["exists","up"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6801","nonce":2289461189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6803","nonce":2289461189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6807","nonce":2289461189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6805","nonce":2289461189}]},"public_addr":"172.21.15.169:6801/2289461189","cluster_addr":"172.21.15.169:6803/2289461189","heartbeat_back_addr":"172.21.15.169:6807/2289461189","heartbeat_front_addr":"172.21.15.169:6805/2289461189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.128898+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.046114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:14.639048+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:22.601 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-14T21:23:22.601 INFO:tasks.ceph:Creating RBD pool 2024-09-14T21:23:22.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 osd pool create rbd 8 2024-09-14T21:23:23.160 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'rbd' created 2024-09-14T21:23:23.181 DEBUG:teuthology.orchestra.run.smithi169:> rbd --cluster cluster2 pool init rbd 2024-09-14T21:23:26.198 INFO:tasks.ceph:Starting mds daemons in cluster cluster2... 2024-09-14T21:23:26.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 config log 1 --format=json 2024-09-14T21:23:26.199 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T21:23:26.554 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:26.572 INFO:teuthology.orchestra.run.smithi169.stdout:[{"version":4,"timestamp":"2024-09-14T21:23:17.259702+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"4399.828669"}]}] 2024-09-14T21:23:26.572 INFO:tasks.ceph_manager:config epoch is 4 2024-09-14T21:23:26.572 INFO:tasks.ceph:Waiting until cluster2 daemons up and pgs clean... 2024-09-14T21:23:26.572 INFO:tasks.ceph.ceph_manager.cluster2:waiting for mgr available 2024-09-14T21:23:26.572 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 mgr dump --format=json 2024-09-14T21:23:26.971 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:26.988 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2285237175},{"type":"v1","addr":"172.21.15.169:6825","nonce":2285237175}]},"active_addr":"172.21.15.169:6825/2285237175","active_change":"2024-09-14T21:23:12.319179+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1047390751}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":2405860339}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3601291633}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3779993960}]}]} 2024-09-14T21:23:26.991 INFO:tasks.ceph.ceph_manager.cluster2:mgr available! 2024-09-14T21:23:26.991 INFO:tasks.ceph.ceph_manager.cluster2:waiting for all up 2024-09-14T21:23:26.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:27.346 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:27.347 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":15,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:26.167448+0000","last_up_change":"2024-09-14T21:23:18.140776+0000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:23:18.350689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:23:22.949482+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6809","nonce":1172764576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6811","nonce":1172764576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6815","nonce":1172764576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6813","nonce":1172764576}]},"public_addr":"172.21.15.169:6809/1172764576","cluster_addr":"172.21.15.169:6811/1172764576","heartbeat_back_addr":"172.21.15.169:6815/1172764576","heartbeat_front_addr":"172.21.15.169:6813/1172764576","state":["exists","up"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6817","nonce":1042050961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6819","nonce":1042050961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6823","nonce":1042050961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6821","nonce":1042050961}]},"public_addr":"172.21.15.169:6817/1042050961","cluster_addr":"172.21.15.169:6819/1042050961","heartbeat_back_addr":"172.21.15.169:6823/1042050961","heartbeat_front_addr":"172.21.15.169:6821/1042050961","state":["exists","up"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6801","nonce":2289461189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6803","nonce":2289461189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6807","nonce":2289461189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6805","nonce":2289461189}]},"public_addr":"172.21.15.169:6801/2289461189","cluster_addr":"172.21.15.169:6803/2289461189","heartbeat_back_addr":"172.21.15.169:6807/2289461189","heartbeat_front_addr":"172.21.15.169:6805/2289461189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.128898+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.046114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:14.639048+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:27.364 INFO:tasks.ceph.ceph_manager.cluster2:all up! 2024-09-14T21:23:27.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-14T21:23:27.714 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:27.714 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":15,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T21:23:26.167448+0000","last_up_change":"2024-09-14T21:23:18.140776+0000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:23:18.350689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:23:22.949482+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6809","nonce":1172764576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6811","nonce":1172764576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6815","nonce":1172764576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6813","nonce":1172764576}]},"public_addr":"172.21.15.169:6809/1172764576","cluster_addr":"172.21.15.169:6811/1172764576","heartbeat_back_addr":"172.21.15.169:6815/1172764576","heartbeat_front_addr":"172.21.15.169:6813/1172764576","state":["exists","up"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6817","nonce":1042050961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6819","nonce":1042050961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6823","nonce":1042050961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6821","nonce":1042050961}]},"public_addr":"172.21.15.169:6817/1042050961","cluster_addr":"172.21.15.169:6819/1042050961","heartbeat_back_addr":"172.21.15.169:6823/1042050961","heartbeat_front_addr":"172.21.15.169:6821/1042050961","state":["exists","up"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6801","nonce":2289461189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6803","nonce":2289461189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6807","nonce":2289461189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6805","nonce":2289461189}]},"public_addr":"172.21.15.169:6801/2289461189","cluster_addr":"172.21.15.169:6803/2289461189","heartbeat_back_addr":"172.21.15.169:6807/2289461189","heartbeat_front_addr":"172.21.15.169:6805/2289461189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.128898+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.046114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:14.639048+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T21:23:27.732 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 flush_pg_stats 2024-09-14T21:23:27.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 flush_pg_stats 2024-09-14T21:23:27.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 flush_pg_stats 2024-09-14T21:23:27.936 INFO:teuthology.orchestra.run.smithi169.stdout:34359738372 2024-09-14T21:23:27.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2024-09-14T21:23:27.956 INFO:teuthology.orchestra.run.smithi169.stdout:34359738373 2024-09-14T21:23:27.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2024-09-14T21:23:27.957 INFO:teuthology.orchestra.run.smithi169.stdout:34359738373 2024-09-14T21:23:27.957 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2024-09-14T21:23:28.307 INFO:teuthology.orchestra.run.smithi169.stdout:34359738371 2024-09-14T21:23:28.326 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738371 for osd.1 2024-09-14T21:23:28.371 INFO:teuthology.orchestra.run.smithi169.stdout:34359738372 2024-09-14T21:23:28.377 INFO:teuthology.orchestra.run.smithi169.stdout:34359738372 2024-09-14T21:23:28.390 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738372 for osd.0 2024-09-14T21:23:28.394 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738372 for osd.2 2024-09-14T21:23:29.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2024-09-14T21:23:29.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2024-09-14T21:23:29.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2024-09-14T21:23:29.708 INFO:teuthology.orchestra.run.smithi169.stdout:34359738372 2024-09-14T21:23:29.728 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738372 for osd.1 2024-09-14T21:23:29.728 DEBUG:teuthology.parallel:result is None 2024-09-14T21:23:29.761 INFO:teuthology.orchestra.run.smithi169.stdout:34359738373 2024-09-14T21:23:29.773 INFO:teuthology.orchestra.run.smithi169.stdout:34359738373 2024-09-14T21:23:29.779 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738373 for osd.0 2024-09-14T21:23:29.779 DEBUG:teuthology.parallel:result is None 2024-09-14T21:23:29.792 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738373 for osd.2 2024-09-14T21:23:29.792 DEBUG:teuthology.parallel:result is None 2024-09-14T21:23:29.792 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2024-09-14T21:23:29.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T21:23:30.177 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:30.178 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T21:23:30.195 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-14T21:23:28.328860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82648,"kb_used_data":1552,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032872,"statfs":{"total":289910292480,"available":289825660928,"internally_reserved":0,"allocated":1589248,"data_stored":1295959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.168500"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177432+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T21:23:26.177432+0000","last_peered":"2024-09-14T21:23:26.177432+0000","last_clean":"2024-09-14T21:23:26.177432+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T21:23:26.177432+0000","last_undegraded":"2024-09-14T21:23:26.177432+0000","last_fullsized":"2024-09-14T21:23:26.177432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177167+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T21:23:26.177167+0000","last_peered":"2024-09-14T21:23:26.177167+0000","last_clean":"2024-09-14T21:23:26.177167+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T21:23:26.177167+0000","last_undegraded":"2024-09-14T21:23:26.177167+0000","last_fullsized":"2024-09-14T21:23:26.177167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177098+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T21:23:26.177098+0000","last_peered":"2024-09-14T21:23:26.177098+0000","last_clean":"2024-09-14T21:23:26.177098+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T21:23:26.177098+0000","last_undegraded":"2024-09-14T21:23:26.177098+0000","last_fullsized":"2024-09-14T21:23:26.177098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.176741+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T21:23:26.176741+0000","last_peered":"2024-09-14T21:23:26.176741+0000","last_clean":"2024-09-14T21:23:26.176741+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T21:23:26.176741+0000","last_undegraded":"2024-09-14T21:23:26.176741+0000","last_fullsized":"2024-09-14T21:23:26.176741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.173406+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T21:23:26.173406+0000","last_peered":"2024-09-14T21:23:26.173406+0000","last_clean":"2024-09-14T21:23:26.173406+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T21:23:26.173406+0000","last_undegraded":"2024-09-14T21:23:26.173406+0000","last_fullsized":"2024-09-14T21:23:26.173406+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.221675+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T21:23:26.221675+0000","last_peered":"2024-09-14T21:23:26.221675+0000","last_clean":"2024-09-14T21:23:26.221675+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T21:23:26.221675+0000","last_undegraded":"2024-09-14T21:23:26.221675+0000","last_fullsized":"2024-09-14T21:23:26.221675+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.221612+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T21:23:26.221612+0000","last_peered":"2024-09-14T21:23:26.221612+0000","last_clean":"2024-09-14T21:23:26.221612+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T21:23:26.221612+0000","last_undegraded":"2024-09-14T21:23:26.221612+0000","last_fullsized":"2024-09-14T21:23:26.221612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.176641+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T21:23:26.176641+0000","last_peered":"2024-09-14T21:23:26.176641+0000","last_clean":"2024-09-14T21:23:26.176641+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T21:23:26.176641+0000","last_undegraded":"2024-09-14T21:23:26.176641+0000","last_fullsized":"2024-09-14T21:23:26.176641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.175954+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T21:23:26.175954+0000","last_peered":"2024-09-14T21:23:26.175954+0000","last_clean":"2024-09-14T21:23:26.175954+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T21:23:26.175954+0000","last_undegraded":"2024-09-14T21:23:26.175954+0000","last_fullsized":"2024-09-14T21:23:26.175954+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":38395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T21:23:30.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T21:23:30.541 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:30.542 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T21:23:30.558 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-14T21:23:30.329167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82648,"kb_used_data":1552,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032872,"statfs":{"total":289910292480,"available":289825660928,"internally_reserved":0,"allocated":1589248,"data_stored":1295959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.168806"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177432+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T21:23:26.177432+0000","last_peered":"2024-09-14T21:23:26.177432+0000","last_clean":"2024-09-14T21:23:26.177432+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T21:23:26.177432+0000","last_undegraded":"2024-09-14T21:23:26.177432+0000","last_fullsized":"2024-09-14T21:23:26.177432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177167+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T21:23:26.177167+0000","last_peered":"2024-09-14T21:23:26.177167+0000","last_clean":"2024-09-14T21:23:26.177167+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T21:23:26.177167+0000","last_undegraded":"2024-09-14T21:23:26.177167+0000","last_fullsized":"2024-09-14T21:23:26.177167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.177098+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T21:23:26.177098+0000","last_peered":"2024-09-14T21:23:26.177098+0000","last_clean":"2024-09-14T21:23:26.177098+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T21:23:26.177098+0000","last_undegraded":"2024-09-14T21:23:26.177098+0000","last_fullsized":"2024-09-14T21:23:26.177098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.176741+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T21:23:26.176741+0000","last_peered":"2024-09-14T21:23:26.176741+0000","last_clean":"2024-09-14T21:23:26.176741+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T21:23:26.176741+0000","last_undegraded":"2024-09-14T21:23:26.176741+0000","last_fullsized":"2024-09-14T21:23:26.176741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.173406+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T21:23:26.173406+0000","last_peered":"2024-09-14T21:23:26.173406+0000","last_clean":"2024-09-14T21:23:26.173406+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T21:23:26.173406+0000","last_undegraded":"2024-09-14T21:23:26.173406+0000","last_fullsized":"2024-09-14T21:23:26.173406+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.221675+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T21:23:26.221675+0000","last_peered":"2024-09-14T21:23:26.221675+0000","last_clean":"2024-09-14T21:23:26.221675+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T21:23:26.221675+0000","last_undegraded":"2024-09-14T21:23:26.221675+0000","last_fullsized":"2024-09-14T21:23:26.221675+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.221612+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T21:23:26.221612+0000","last_peered":"2024-09-14T21:23:26.221612+0000","last_clean":"2024-09-14T21:23:26.221612+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T21:23:26.221612+0000","last_undegraded":"2024-09-14T21:23:26.221612+0000","last_fullsized":"2024-09-14T21:23:26.221612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.176641+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T21:23:26.176641+0000","last_peered":"2024-09-14T21:23:26.176641+0000","last_clean":"2024-09-14T21:23:26.176641+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T21:23:26.176641+0000","last_undegraded":"2024-09-14T21:23:26.176641+0000","last_fullsized":"2024-09-14T21:23:26.176641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-14T21:23:26.175954+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T21:23:26.175954+0000","last_peered":"2024-09-14T21:23:26.175954+0000","last_clean":"2024-09-14T21:23:26.175954+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T21:23:26.175954+0000","last_undegraded":"2024-09-14T21:23:26.175954+0000","last_fullsized":"2024-09-14T21:23:26.175954+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":38395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":628782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T21:23:30.559 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2024-09-14T21:23:30.559 INFO:tasks.ceph:Waiting until ceph cluster cluster2 is healthy... 2024-09-14T21:23:30.559 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy 2024-09-14T21:23:30.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 health --format=json 2024-09-14T21:23:30.940 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T21:23:30.940 INFO:teuthology.orchestra.run.smithi169.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T21:23:30.958 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy done 2024-09-14T21:23:30.958 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-14T21:23:30.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-14T21:23:30.968 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-14T21:23:30.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-14T21:23:30.972 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-14T21:23:30.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-14T21:23:30.981 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-14T21:23:30.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-14T21:23:30.985 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T21:23:30.997 INFO:tasks.workunit:Pulling workunits from ref 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:23:30.998 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T21:23:30.998 DEBUG:teuthology.orchestra.run.smithi169:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-14T21:23:31.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T21:23:31.033 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2024-09-14T21:23:31.033 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-14T21:23:31.111 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-14T21:23:31.111 DEBUG:teuthology.orchestra.run.smithi169:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2024-09-14T21:23:31.186 INFO:tasks.workunit:timeout=3h 2024-09-14T21:23:31.186 INFO:tasks.workunit:cleanup=True 2024-09-14T21:23:31.187 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout 711c10c3b606220cc536e8cfed3eb9d03ecd33d1 2024-09-14T21:23:31.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2024-09-14T21:24:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Updating files: 65% (8387/12889) Updating files: 66% (8507/12889) Updating files: 67% (8636/12889) Updating files: 68% (8765/12889) Updating files: 69% (8894/12889) Updating files: 70% (9023/12889) Updating files: 71% (9152/12889) Updating files: 72% (9281/12889) Updating files: 73% (9409/12889) Updating files: 74% (9538/12889) Updating files: 75% (9667/12889) Updating files: 76% (9796/12889) Updating files: 77% (9925/12889) Updating files: 78% (10054/12889) Updating files: 79% (10183/12889) Updating files: 80% (10312/12889) Updating files: 81% (10441/12889) Updating files: 82% (10569/12889) Updating files: 83% (10698/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Note: switching to '711c10c3b606220cc536e8cfed3eb9d03ecd33d1'. 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: git switch -c 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Or undo this operation with: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: git switch - 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:35.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:HEAD is now at 711c10c3b60 Merge pull request #59732 from zdover23/wip-doc-2024-09-11-README-md-formatting 2024-09-14T21:24:35.483 DEBUG:teuthology.orchestra.run.smithi169:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2024-09-14T21:24:35.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T21:24:35.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-14T21:24:35.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T21:24:36.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T21:24:36.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T21:24:36.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-14T21:24:36.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-14T21:24:36.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T21:24:36.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-14T21:24:36.467 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-14T21:24:36.467 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror of=/dev/stdout 2024-09-14T21:24:36.542 INFO:tasks.workunit:Running workunits matching rbd/compare_mirror_images.sh on cluster1.client.mirror... 2024-09-14T21:24:36.544 INFO:tasks.workunit:Running workunit rbd/compare_mirror_images.sh... 2024-09-14T21:24:36.544 DEBUG:teuthology.orchestra.run.smithi169:workunit test rbd/compare_mirror_images.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=711c10c3b606220cc536e8cfed3eb9d03ecd33d1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror RBD_DEVICE_TYPE=krbd RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_images.sh 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG_PREFIX=image-primary 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MIRROR_IMAGE_MODE=snapshot 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MIRROR_POOL_MODE=image 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT_PREFIX=test-primary 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RBD_MIRROR_INSTANCES=1 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RBD_MIRROR_MODE=snapshot 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RBD_MIRROR_USE_EXISTING_CLUSTER=1 2024-09-14T21:24:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_images.sh 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ RBD_MIRROR_INSTANCES=1 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CLUSTER1=cluster1 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CLUSTER2=cluster2 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ PEER_CLUSTER_SUFFIX= 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ POOL=mirror 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ PARENT_POOL=mirror_parent 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ NS1=ns1 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ NS2=ns2 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ TEMPDIR= 2024-09-14T21:24:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ID=mirror 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ MIRROR_USER_ID_PREFIX=mirror. 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ RBD_MIRROR_MODE=snapshot 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ MIRROR_POOL_MODE=image 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ '[' snapshot = snapshot ']' 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ MIRROR_POOL_MODE=image 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ export 'CEPH_ARGS=--id mirror' 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS='--id mirror' 2024-09-14T21:24:36.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ LAST_MIRROR_INSTANCE=0 2024-09-14T21:24:36.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/compare_mirror_images.sh 2024-09-14T21:24:36.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+++ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2024-09-14T21:24:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2024-09-14T21:24:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_BIN=. 2024-09-14T21:24:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_SRC=. 2024-09-14T21:24:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ '[' -e CMakeCache.txt ']' 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ '[' 0 -gt 0 ']' 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ setup 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local c 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ trap 'cleanup $?' INT TERM EXIT 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ setup_tempdir 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ mktemp -d 2024-09-14T21:24:36.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ TEMPDIR=/tmp/tmp.jVjUGLUi4Z 2024-09-14T21:24:36.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z 1 ']' 2024-09-14T21:24:36.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ setup_pools cluster1 cluster2 2024-09-14T21:24:36.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster2 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mon_map_file 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mon_addr 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local admin_key_file 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster1 osd pool create mirror 64 64 2024-09-14T21:24:37.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror' already exists 2024-09-14T21:24:37.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:37.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster1 osd pool create mirror_parent 64 64 2024-09-14T21:24:38.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror_parent' already exists 2024-09-14T21:24:38.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:38.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 pool init mirror 2024-09-14T21:24:41.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:41.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 pool init mirror_parent 2024-09-14T21:24:44.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:44.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:44.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror pool enable --site-name cluster1 mirror image 2024-09-14T21:24:44.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror pool enable mirror_parent image 2024-09-14T21:24:44.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 namespace create mirror/ns1 2024-09-14T21:24:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 namespace create mirror/ns2 2024-09-14T21:24:44.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns1 image 2024-09-14T21:24:44.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns2 image 2024-09-14T21:24:44.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z ']' 2024-09-14T21:24:44.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z ']' 2024-09-14T21:24:44.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_add cluster1 mirror cluster2 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local client_cluster=cluster2 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster2 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid_var_name 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local error_code 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local peer_uuid 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 16 32 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set +e 2024-09-14T21:24:44.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror cluster2 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_uuid=c41115ee-dcb9-45ce-8d8e-f4370b3d6782 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ error_code=0 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set -e 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -eq 17 ']' 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test 0 -eq 0 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_add cluster1 mirror_parent cluster2 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror_parent 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local client_cluster=cluster2 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster2 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid_var_name 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local error_code 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local peer_uuid 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 16 32 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set +e 2024-09-14T21:24:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror_parent cluster2 2024-09-14T21:24:44.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_uuid=622acb08-72b7-4594-a4b3-e53fae6cd4ea 2024-09-14T21:24:44.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ error_code=0 2024-09-14T21:24:44.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set -e 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -eq 17 ']' 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test 0 -eq 0 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ setup_pools cluster2 cluster1 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster1 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mon_map_file 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mon_addr 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local admin_key_file 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:44.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster2 osd pool create mirror 64 64 2024-09-14T21:24:45.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror' already exists 2024-09-14T21:24:45.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:45.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster2 osd pool create mirror_parent 64 64 2024-09-14T21:24:46.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror_parent' already exists 2024-09-14T21:24:46.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:46.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 pool init mirror 2024-09-14T21:24:49.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:49.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 pool init mirror_parent 2024-09-14T21:24:52.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T21:24:52.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 mirror pool enable --site-name cluster2 mirror image 2024-09-14T21:24:52.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 mirror pool enable mirror_parent image 2024-09-14T21:24:52.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 namespace create mirror/ns1 2024-09-14T21:24:52.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 namespace create mirror/ns2 2024-09-14T21:24:52.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns1 image 2024-09-14T21:24:52.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns2 image 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z ']' 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z ']' 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_add cluster2 mirror cluster1 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local client_cluster=cluster1 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster1 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid_var_name 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local error_code 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local peer_uuid 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 16 32 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set +e 2024-09-14T21:24:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror cluster1 2024-09-14T21:24:52.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_uuid=daee1cd6-bc8a-4aa5-804f-09cad350ab71 2024-09-14T21:24:52.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ error_code=0 2024-09-14T21:24:52.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set -e 2024-09-14T21:24:52.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -eq 17 ']' 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test 0 -eq 0 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_add cluster2 mirror_parent cluster1 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror_parent 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local client_cluster=cluster1 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local remote_cluster=cluster1 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local uuid_var_name 2024-09-14T21:24:52.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local error_code 2024-09-14T21:24:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local peer_uuid 2024-09-14T21:24:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 16 32 2024-09-14T21:24:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set +e 2024-09-14T21:24:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror_parent cluster1 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ peer_uuid=3ea1417d-7e7c-4bb5-b310-8a6104acc7f1 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ error_code=0 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set -e 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -eq 17 ']' 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test 0 -eq 0 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ start_mirrors cluster1 2024-09-14T21:24:52.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:52.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ seq 0 0 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ start_mirror cluster1:0 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1:0 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local instance 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set_cluster_instance cluster1:0 cluster instance 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local val=cluster1:0 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster_var_name=cluster 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local instance_var_name=instance 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cluster=cluster1 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ instance=0 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 = cluster1:0 ']' 2024-09-14T21:24:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ eval cluster=cluster1 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ cluster=cluster1 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ eval instance=0 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ instance=0 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test -n 1 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ start_mirrors cluster2 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:24:52.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ seq 0 0 2024-09-14T21:24:52.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-14T21:24:52.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ start_mirror cluster2:0 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2:0 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local instance 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set_cluster_instance cluster2:0 cluster instance 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local val=cluster2:0 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster_var_name=cluster 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local instance_var_name=instance 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cluster=cluster2 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ instance=0 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 = cluster2:0 ']' 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ eval cluster=cluster2 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ cluster=cluster2 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ eval instance=0 2024-09-14T21:24:52.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ instance=0 2024-09-14T21:24:52.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test -n 1 2024-09-14T21:24:52.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 2024-09-14T21:24:52.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wget https://download.ceph.com/qa/linux-5.4.tar.gz 2024-09-14T21:24:52.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:--2024-09-14 21:24:52-- https://download.ceph.com/qa/linux-5.4.tar.gz 2024-09-14T21:24:53.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-14T21:24:53.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected. 2024-09-14T21:24:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T21:24:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-09-14T21:24:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:Saving to: ‘linux-5.4.tar.gz’ 2024-09-14T21:24:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:53.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 0K .......... .......... .......... .......... .......... 0% 2.40M 69s 2024-09-14T21:24:53.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50K .......... .......... .......... .......... .......... 0% 2.37M 69s 2024-09-14T21:24:53.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 100K .......... .......... .......... .......... .......... 0% 144M 46s 2024-09-14T21:24:53.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 150K .......... .......... .......... .......... .......... 0% 2.44M 52s 2024-09-14T21:24:53.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 200K .......... .......... .......... .......... .......... 0% 171M 41s 2024-09-14T21:24:53.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 250K .......... .......... .......... .......... .......... 0% 144M 35s 2024-09-14T21:24:53.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 300K .......... .......... .......... .......... .......... 0% 196M 30s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 350K .......... .......... .......... .......... .......... 0% 2.51M 34s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 400K .......... .......... .......... .......... .......... 0% 109M 31s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 450K .......... .......... .......... .......... .......... 0% 183M 28s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 500K .......... .......... .......... .......... .......... 0% 169M 25s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 550K .......... .......... .......... .......... .......... 0% 168M 23s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 600K .......... .......... .......... .......... .......... 0% 203M 21s 2024-09-14T21:24:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 650K .......... .......... .......... .......... .......... 0% 175M 20s 2024-09-14T21:24:53.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 700K .......... .......... .......... .......... .......... 0% 188M 19s 2024-09-14T21:24:53.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 750K .......... .......... .......... .......... .......... 0% 25.2M 18s 2024-09-14T21:24:53.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 800K .......... .......... .......... .......... .......... 0% 2.92M 20s 2024-09-14T21:24:53.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 850K .......... .......... .......... .......... .......... 0% 172M 19s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 900K .......... .......... .......... .......... .......... 0% 193M 18s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 950K .......... .......... .......... .......... .......... 0% 175M 17s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1000K .......... .......... .......... .......... .......... 0% 184M 17s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1050K .......... .......... .......... .......... .......... 0% 193M 16s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1100K .......... .......... .......... .......... .......... 0% 192M 15s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1150K .......... .......... .......... .......... .......... 0% 23.1M 15s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1200K .......... .......... .......... .......... .......... 0% 35.6M 14s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1250K .......... .......... .......... .......... .......... 0% 26.0M 14s 2024-09-14T21:24:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1300K .......... .......... .......... .......... .......... 0% 41.3M 14s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1350K .......... .......... .......... .......... .......... 0% 3.85M 15s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1400K .......... .......... .......... .......... .......... 0% 164M 14s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1450K .......... .......... .......... .......... .......... 0% 197M 14s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1500K .......... .......... .......... .......... .......... 0% 194M 13s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1550K .......... .......... .......... .......... .......... 0% 169M 13s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1600K .......... .......... .......... .......... .......... 0% 192M 13s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1650K .......... .......... .......... .......... .......... 1% 192M 12s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1700K .......... .......... .......... .......... .......... 1% 202M 12s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1750K .......... .......... .......... .......... .......... 1% 23.9M 12s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1800K .......... .......... .......... .......... .......... 1% 44.9M 12s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1850K .......... .......... .......... .......... .......... 1% 22.7M 11s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1900K .......... .......... .......... .......... .......... 1% 56.7M 11s 2024-09-14T21:24:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 1950K .......... .......... .......... .......... .......... 1% 22.9M 11s 2024-09-14T21:24:53.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2000K .......... .......... .......... .......... .......... 1% 4.58M 12s 2024-09-14T21:24:53.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2050K .......... .......... .......... .......... .......... 1% 150M 11s 2024-09-14T21:24:53.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2100K .......... .......... .......... .......... .......... 1% 187M 11s 2024-09-14T21:24:53.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2150K .......... .......... .......... .......... .......... 1% 164M 11s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2200K .......... .......... .......... .......... .......... 1% 143M 11s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2250K .......... .......... .......... .......... .......... 1% 193M 11s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2300K .......... .......... .......... .......... .......... 1% 156M 10s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2350K .......... .......... .......... .......... .......... 1% 26.1M 10s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2400K .......... .......... .......... .......... .......... 1% 28.9M 10s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2450K .......... .......... .......... .......... .......... 1% 52.4M 10s 2024-09-14T21:24:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2500K .......... .......... .......... .......... .......... 1% 24.4M 10s 2024-09-14T21:24:53.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2550K .......... .......... .......... .......... .......... 1% 37.0M 10s 2024-09-14T21:24:53.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2600K .......... .......... .......... .......... .......... 1% 31.2M 10s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2650K .......... .......... .......... .......... .......... 1% 5.23M 10s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2700K .......... .......... .......... .......... .......... 1% 186M 10s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2750K .......... .......... .......... .......... .......... 1% 146M 10s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2800K .......... .......... .......... .......... .......... 1% 200M 10s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2850K .......... .......... .......... .......... .......... 1% 189M 9s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2900K .......... .......... .......... .......... .......... 1% 134M 9s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2950K .......... .......... .......... .......... .......... 1% 37.0M 9s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3000K .......... .......... .......... .......... .......... 1% 32.1M 9s 2024-09-14T21:24:53.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3050K .......... .......... .......... .......... .......... 1% 27.3M 9s 2024-09-14T21:24:53.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3100K .......... .......... .......... .......... .......... 1% 23.6M 9s 2024-09-14T21:24:53.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3150K .......... .......... .......... .......... .......... 1% 26.3M 9s 2024-09-14T21:24:53.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3200K .......... .......... .......... .......... .......... 1% 24.3M 9s 2024-09-14T21:24:53.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3250K .......... .......... .......... .......... .......... 1% 56.7M 9s 2024-09-14T21:24:53.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3300K .......... .......... .......... .......... .......... 1% 6.39M 9s 2024-09-14T21:24:53.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3350K .......... .......... .......... .......... .......... 2% 139M 9s 2024-09-14T21:24:53.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3400K .......... .......... .......... .......... .......... 2% 171M 9s 2024-09-14T21:24:53.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3450K .......... .......... .......... .......... .......... 2% 197M 9s 2024-09-14T21:24:53.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3500K .......... .......... .......... .......... .......... 2% 199M 9s 2024-09-14T21:24:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3550K .......... .......... .......... .......... .......... 2% 29.1M 9s 2024-09-14T21:24:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3600K .......... .......... .......... .......... .......... 2% 30.4M 9s 2024-09-14T21:24:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3650K .......... .......... .......... .......... .......... 2% 25.8M 9s 2024-09-14T21:24:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3700K .......... .......... .......... .......... .......... 2% 54.5M 8s 2024-09-14T21:24:53.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3750K .......... .......... .......... .......... .......... 2% 23.5M 8s 2024-09-14T21:24:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3800K .......... .......... .......... .......... .......... 2% 31.0M 8s 2024-09-14T21:24:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3850K .......... .......... .......... .......... .......... 2% 25.1M 8s 2024-09-14T21:24:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3900K .......... .......... .......... .......... .......... 2% 26.0M 8s 2024-09-14T21:24:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 3950K .......... .......... .......... .......... .......... 2% 9.27M 8s 2024-09-14T21:24:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4000K .......... .......... .......... .......... .......... 2% 95.7M 8s 2024-09-14T21:24:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4050K .......... .......... .......... .......... .......... 2% 191M 8s 2024-09-14T21:24:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4100K .......... .......... .......... .......... .......... 2% 160M 8s 2024-09-14T21:24:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4150K .......... .......... .......... .......... .......... 2% 25.1M 8s 2024-09-14T21:24:53.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4200K .......... .......... .......... .......... .......... 2% 57.8M 8s 2024-09-14T21:24:53.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4250K .......... .......... .......... .......... .......... 2% 23.2M 8s 2024-09-14T21:24:53.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4300K .......... .......... .......... .......... .......... 2% 30.3M 8s 2024-09-14T21:24:53.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4350K .......... .......... .......... .......... .......... 2% 22.3M 8s 2024-09-14T21:24:53.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4400K .......... .......... .......... .......... .......... 2% 25.4M 8s 2024-09-14T21:24:53.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4450K .......... .......... .......... .......... .......... 2% 26.8M 8s 2024-09-14T21:24:53.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4500K .......... .......... .......... .......... .......... 2% 48.0M 8s 2024-09-14T21:24:53.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4550K .......... .......... .......... .......... .......... 2% 35.6M 8s 2024-09-14T21:24:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4600K .......... .......... .......... .......... .......... 2% 25.9M 8s 2024-09-14T21:24:53.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4650K .......... .......... .......... .......... .......... 2% 25.8M 8s 2024-09-14T21:24:53.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4700K .......... .......... .......... .......... .......... 2% 49.9M 8s 2024-09-14T21:24:53.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4750K .......... .......... .......... .......... .......... 2% 21.3M 8s 2024-09-14T21:24:53.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4800K .......... .......... .......... .......... .......... 2% 29.2M 8s 2024-09-14T21:24:53.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4850K .......... .......... .......... .......... .......... 2% 30.4M 8s 2024-09-14T21:24:53.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4900K .......... .......... .......... .......... .......... 2% 20.6M 8s 2024-09-14T21:24:53.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 4950K .......... .......... .......... .......... .......... 2% 40.9M 8s 2024-09-14T21:24:53.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5000K .......... .......... .......... .......... .......... 2% 36.0M 8s 2024-09-14T21:24:53.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5050K .......... .......... .......... .......... .......... 3% 31.6M 8s 2024-09-14T21:24:53.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5100K .......... .......... .......... .......... .......... 3% 30.7M 8s 2024-09-14T21:24:53.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5150K .......... .......... .......... .......... .......... 3% 24.4M 8s 2024-09-14T21:24:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5200K .......... .......... .......... .......... .......... 3% 21.6M 8s 2024-09-14T21:24:53.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5250K .......... .......... .......... .......... .......... 3% 54.9M 8s 2024-09-14T21:24:53.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5300K .......... .......... .......... .......... .......... 3% 24.1M 8s 2024-09-14T21:24:53.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5350K .......... .......... .......... .......... .......... 3% 21.2M 8s 2024-09-14T21:24:53.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5400K .......... .......... .......... .......... .......... 3% 42.2M 7s 2024-09-14T21:24:53.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5450K .......... .......... .......... .......... .......... 3% 23.7M 7s 2024-09-14T21:24:53.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5500K .......... .......... .......... .......... .......... 3% 67.5M 7s 2024-09-14T21:24:53.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5550K .......... .......... .......... .......... .......... 3% 24.4M 7s 2024-09-14T21:24:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5600K .......... .......... .......... .......... .......... 3% 27.2M 7s 2024-09-14T21:24:53.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5650K .......... .......... .......... .......... .......... 3% 27.8M 7s 2024-09-14T21:24:53.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5700K .......... .......... .......... .......... .......... 3% 24.3M 7s 2024-09-14T21:24:53.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5750K .......... .......... .......... .......... .......... 3% 53.7M 7s 2024-09-14T21:24:53.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5800K .......... .......... .......... .......... .......... 3% 23.7M 7s 2024-09-14T21:24:53.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5850K .......... .......... .......... .......... .......... 3% 34.2M 7s 2024-09-14T21:24:53.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5900K .......... .......... .......... .......... .......... 3% 23.6M 7s 2024-09-14T21:24:53.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 5950K .......... .......... .......... .......... .......... 3% 26.8M 7s 2024-09-14T21:24:53.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6000K .......... .......... .......... .......... .......... 3% 18.4M 7s 2024-09-14T21:24:53.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6050K .......... .......... .......... .......... .......... 3% 66.1M 7s 2024-09-14T21:24:53.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6100K .......... .......... .......... .......... .......... 3% 29.5M 7s 2024-09-14T21:24:53.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6150K .......... .......... .......... .......... .......... 3% 23.3M 7s 2024-09-14T21:24:53.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6200K .......... .......... .......... .......... .......... 3% 24.7M 7s 2024-09-14T21:24:53.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6250K .......... .......... .......... .......... .......... 3% 52.4M 7s 2024-09-14T21:24:53.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6300K .......... .......... .......... .......... .......... 3% 31.6M 7s 2024-09-14T21:24:53.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6350K .......... .......... .......... .......... .......... 3% 25.4M 7s 2024-09-14T21:24:53.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6400K .......... .......... .......... .......... .......... 3% 33.6M 7s 2024-09-14T21:24:53.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6450K .......... .......... .......... .......... .......... 3% 19.0M 7s 2024-09-14T21:24:53.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6500K .......... .......... .......... .......... .......... 3% 57.6M 7s 2024-09-14T21:24:53.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6550K .......... .......... .......... .......... .......... 3% 23.3M 7s 2024-09-14T21:24:53.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6600K .......... .......... .......... .......... .......... 3% 21.9M 7s 2024-09-14T21:24:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6650K .......... .......... .......... .......... .......... 3% 36.9M 7s 2024-09-14T21:24:53.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6700K .......... .......... .......... .......... .......... 4% 69.2M 7s 2024-09-14T21:24:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6750K .......... .......... .......... .......... .......... 4% 25.0M 7s 2024-09-14T21:24:53.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6800K .......... .......... .......... .......... .......... 4% 24.2M 7s 2024-09-14T21:24:53.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6850K .......... .......... .......... .......... .......... 4% 23.3M 7s 2024-09-14T21:24:53.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6900K .......... .......... .......... .......... .......... 4% 37.7M 7s 2024-09-14T21:24:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 6950K .......... .......... .......... .......... .......... 4% 22.0M 7s 2024-09-14T21:24:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7000K .......... .......... .......... .......... .......... 4% 49.9M 7s 2024-09-14T21:24:53.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7050K .......... .......... .......... .......... .......... 4% 26.4M 7s 2024-09-14T21:24:53.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7100K .......... .......... .......... .......... .......... 4% 36.6M 7s 2024-09-14T21:24:53.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7150K .......... .......... .......... .......... .......... 4% 23.4M 7s 2024-09-14T21:24:53.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7200K .......... .......... .......... .......... .......... 4% 22.3M 7s 2024-09-14T21:24:53.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7250K .......... .......... .......... .......... .......... 4% 70.8M 7s 2024-09-14T21:24:53.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7300K .......... .......... .......... .......... .......... 4% 19.5M 7s 2024-09-14T21:24:53.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7350K .......... .......... .......... .......... .......... 4% 54.2M 7s 2024-09-14T21:24:53.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7400K .......... .......... .......... .......... .......... 4% 21.3M 7s 2024-09-14T21:24:53.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7450K .......... .......... .......... .......... .......... 4% 24.4M 7s 2024-09-14T21:24:53.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7500K .......... .......... .......... .......... .......... 4% 87.1M 7s 2024-09-14T21:24:53.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7550K .......... .......... .......... .......... .......... 4% 22.1M 7s 2024-09-14T21:24:53.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7600K .......... .......... .......... .......... .......... 4% 23.9M 7s 2024-09-14T21:24:53.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7650K .......... .......... .......... .......... .......... 4% 37.7M 7s 2024-09-14T21:24:53.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7700K .......... .......... .......... .......... .......... 4% 24.2M 7s 2024-09-14T21:24:53.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7750K .......... .......... .......... .......... .......... 4% 52.7M 7s 2024-09-14T21:24:53.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7800K .......... .......... .......... .......... .......... 4% 21.0M 7s 2024-09-14T21:24:53.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7850K .......... .......... .......... .......... .......... 4% 46.7M 7s 2024-09-14T21:24:53.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7900K .......... .......... .......... .......... .......... 4% 22.9M 7s 2024-09-14T21:24:53.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 7950K .......... .......... .......... .......... .......... 4% 25.0M 7s 2024-09-14T21:24:53.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8000K .......... .......... .......... .......... .......... 4% 23.1M 7s 2024-09-14T21:24:53.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8050K .......... .......... .......... .......... .......... 4% 55.1M 7s 2024-09-14T21:24:53.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8100K .......... .......... .......... .......... .......... 4% 24.4M 7s 2024-09-14T21:24:53.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8150K .......... .......... .......... .......... .......... 4% 33.9M 7s 2024-09-14T21:24:53.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8200K .......... .......... .......... .......... .......... 4% 22.9M 7s 2024-09-14T21:24:53.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8250K .......... .......... .......... .......... .......... 4% 66.6M 7s 2024-09-14T21:24:53.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8300K .......... .......... .......... .......... .......... 4% 24.0M 7s 2024-09-14T21:24:53.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8350K .......... .......... .......... .......... .......... 4% 23.1M 7s 2024-09-14T21:24:53.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8400K .......... .......... .......... .......... .......... 5% 38.0M 7s 2024-09-14T21:24:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8450K .......... .......... .......... .......... .......... 5% 23.3M 7s 2024-09-14T21:24:53.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8500K .......... .......... .......... .......... .......... 5% 25.2M 7s 2024-09-14T21:24:53.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8550K .......... .......... .......... .......... .......... 5% 62.9M 7s 2024-09-14T21:24:53.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8600K .......... .......... .......... .......... .......... 5% 28.0M 7s 2024-09-14T21:24:53.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8650K .......... .......... .......... .......... .......... 5% 22.7M 7s 2024-09-14T21:24:53.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8700K .......... .......... .......... .......... .......... 5% 29.9M 7s 2024-09-14T21:24:53.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8750K .......... .......... .......... .......... .......... 5% 22.7M 7s 2024-09-14T21:24:53.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8800K .......... .......... .......... .......... .......... 5% 31.8M 7s 2024-09-14T21:24:53.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8850K .......... .......... .......... .......... .......... 5% 24.9M 7s 2024-09-14T21:24:53.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8900K .......... .......... .......... .......... .......... 5% 22.0M 7s 2024-09-14T21:24:53.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 8950K .......... .......... .......... .......... .......... 5% 40.8M 7s 2024-09-14T21:24:53.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9000K .......... .......... .......... .......... .......... 5% 51.1M 7s 2024-09-14T21:24:53.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9050K .......... .......... .......... .......... .......... 5% 25.0M 7s 2024-09-14T21:24:53.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9100K .......... .......... .......... .......... .......... 5% 20.0M 7s 2024-09-14T21:24:53.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9150K .......... .......... .......... .......... .......... 5% 40.9M 7s 2024-09-14T21:24:53.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9200K .......... .......... .......... .......... .......... 5% 26.6M 7s 2024-09-14T21:24:53.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9250K .......... .......... .......... .......... .......... 5% 23.8M 7s 2024-09-14T21:24:53.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9300K .......... .......... .......... .......... .......... 5% 49.3M 7s 2024-09-14T21:24:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9350K .......... .......... .......... .......... .......... 5% 26.8M 6s 2024-09-14T21:24:53.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9400K .......... .......... .......... .......... .......... 5% 33.9M 6s 2024-09-14T21:24:53.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9450K .......... .......... .......... .......... .......... 5% 22.7M 6s 2024-09-14T21:24:53.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9500K .......... .......... .......... .......... .......... 5% 56.9M 6s 2024-09-14T21:24:53.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9550K .......... .......... .......... .......... .......... 5% 24.5M 6s 2024-09-14T21:24:53.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9600K .......... .......... .......... .......... .......... 5% 22.6M 6s 2024-09-14T21:24:53.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9650K .......... .......... .......... .......... .......... 5% 37.5M 6s 2024-09-14T21:24:53.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9700K .......... .......... .......... .......... .......... 5% 24.7M 6s 2024-09-14T21:24:53.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9750K .......... .......... .......... .......... .......... 5% 21.9M 6s 2024-09-14T21:24:53.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9800K .......... .......... .......... .......... .......... 5% 82.7M 6s 2024-09-14T21:24:53.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9850K .......... .......... .......... .......... .......... 5% 20.2M 6s 2024-09-14T21:24:53.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9900K .......... .......... .......... .......... .......... 5% 39.0M 6s 2024-09-14T21:24:53.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 9950K .......... .......... .......... .......... .......... 5% 24.6M 6s 2024-09-14T21:24:53.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10000K .......... .......... .......... .......... .......... 5% 26.3M 6s 2024-09-14T21:24:53.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10050K .......... .......... .......... .......... .......... 5% 50.8M 6s 2024-09-14T21:24:53.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10100K .......... .......... .......... .......... .......... 6% 23.5M 6s 2024-09-14T21:24:53.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10150K .......... .......... .......... .......... .......... 6% 37.9M 6s 2024-09-14T21:24:53.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10200K .......... .......... .......... .......... .......... 6% 19.5M 6s 2024-09-14T21:24:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10250K .......... .......... .......... .......... .......... 6% 31.0M 6s 2024-09-14T21:24:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10300K .......... .......... .......... .......... .......... 6% 49.2M 6s 2024-09-14T21:24:53.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10350K .......... .......... .......... .......... .......... 6% 26.1M 6s 2024-09-14T21:24:53.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10400K .......... .......... .......... .......... .......... 6% 23.8M 6s 2024-09-14T21:24:53.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10450K .......... .......... .......... .......... .......... 6% 40.1M 6s 2024-09-14T21:24:53.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10500K .......... .......... .......... .......... .......... 6% 22.6M 6s 2024-09-14T21:24:53.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10550K .......... .......... .......... .......... .......... 6% 37.3M 6s 2024-09-14T21:24:53.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10600K .......... .......... .......... .......... .......... 6% 28.1M 6s 2024-09-14T21:24:53.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10650K .......... .......... .......... .......... .......... 6% 31.6M 6s 2024-09-14T21:24:53.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10700K .......... .......... .......... .......... .......... 6% 27.6M 6s 2024-09-14T21:24:53.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10750K .......... .......... .......... .......... .......... 6% 22.4M 6s 2024-09-14T21:24:53.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10800K .......... .......... .......... .......... .......... 6% 23.9M 6s 2024-09-14T21:24:53.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10850K .......... .......... .......... .......... .......... 6% 62.0M 6s 2024-09-14T21:24:53.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10900K .......... .......... .......... .......... .......... 6% 33.3M 6s 2024-09-14T21:24:53.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 10950K .......... .......... .......... .......... .......... 6% 21.0M 6s 2024-09-14T21:24:53.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11000K .......... .......... .......... .......... .......... 6% 26.2M 6s 2024-09-14T21:24:53.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11050K .......... .......... .......... .......... .......... 6% 63.3M 6s 2024-09-14T21:24:53.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11100K .......... .......... .......... .......... .......... 6% 22.8M 6s 2024-09-14T21:24:53.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11150K .......... .......... .......... .......... .......... 6% 25.5M 6s 2024-09-14T21:24:53.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11200K .......... .......... .......... .......... .......... 6% 33.3M 6s 2024-09-14T21:24:53.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11250K .......... .......... .......... .......... .......... 6% 36.6M 6s 2024-09-14T21:24:53.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11300K .......... .......... .......... .......... .......... 6% 32.9M 6s 2024-09-14T21:24:53.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11350K .......... .......... .......... .......... .......... 6% 23.3M 6s 2024-09-14T21:24:53.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11400K .......... .......... .......... .......... .......... 6% 33.6M 6s 2024-09-14T21:24:53.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11450K .......... .......... .......... .......... .......... 6% 29.0M 6s 2024-09-14T21:24:53.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11500K .......... .......... .......... .......... .......... 6% 22.5M 6s 2024-09-14T21:24:53.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11550K .......... .......... .......... .......... .......... 6% 21.2M 6s 2024-09-14T21:24:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11600K .......... .......... .......... .......... .......... 6% 51.0M 6s 2024-09-14T21:24:53.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11650K .......... .......... .......... .......... .......... 6% 26.8M 6s 2024-09-14T21:24:53.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11700K .......... .......... .......... .......... .......... 6% 31.4M 6s 2024-09-14T21:24:53.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11750K .......... .......... .......... .......... .......... 7% 14.8M 6s 2024-09-14T21:24:53.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11800K .......... .......... .......... .......... .......... 7% 50.5M 6s 2024-09-14T21:24:53.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11850K .......... .......... .......... .......... .......... 7% 23.4M 6s 2024-09-14T21:24:53.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11900K .......... .......... .......... .......... .......... 7% 29.3M 6s 2024-09-14T21:24:53.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 11950K .......... .......... .......... .......... .......... 7% 26.4M 6s 2024-09-14T21:24:53.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12000K .......... .......... .......... .......... .......... 7% 23.8M 6s 2024-09-14T21:24:53.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12050K .......... .......... .......... .......... .......... 7% 27.1M 6s 2024-09-14T21:24:53.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12100K .......... .......... .......... .......... .......... 7% 39.0M 6s 2024-09-14T21:24:53.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12150K .......... .......... .......... .......... .......... 7% 45.1M 6s 2024-09-14T21:24:53.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12200K .......... .......... .......... .......... .......... 7% 24.5M 6s 2024-09-14T21:24:53.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12250K .......... .......... .......... .......... .......... 7% 22.1M 6s 2024-09-14T21:24:53.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12300K .......... .......... .......... .......... .......... 7% 66.9M 6s 2024-09-14T21:24:53.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12350K .......... .......... .......... .......... .......... 7% 24.2M 6s 2024-09-14T21:24:53.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12400K .......... .......... .......... .......... .......... 7% 28.4M 6s 2024-09-14T21:24:53.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12450K .......... .......... .......... .......... .......... 7% 26.0M 6s 2024-09-14T21:24:53.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12500K .......... .......... .......... .......... .......... 7% 26.0M 6s 2024-09-14T21:24:53.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12550K .......... .......... .......... .......... .......... 7% 24.3M 6s 2024-09-14T21:24:53.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12600K .......... .......... .......... .......... .......... 7% 60.4M 6s 2024-09-14T21:24:53.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12650K .......... .......... .......... .......... .......... 7% 31.8M 6s 2024-09-14T21:24:53.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12700K .......... .......... .......... .......... .......... 7% 26.5M 6s 2024-09-14T21:24:53.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12750K .......... .......... .......... .......... .......... 7% 22.4M 6s 2024-09-14T21:24:53.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12800K .......... .......... .......... .......... .......... 7% 23.7M 6s 2024-09-14T21:24:53.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12850K .......... .......... .......... .......... .......... 7% 60.0M 6s 2024-09-14T21:24:53.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12900K .......... .......... .......... .......... .......... 7% 23.6M 6s 2024-09-14T21:24:53.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 12950K .......... .......... .......... .......... .......... 7% 32.8M 6s 2024-09-14T21:24:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13000K .......... .......... .......... .......... .......... 7% 26.4M 6s 2024-09-14T21:24:53.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13050K .......... .......... .......... .......... .......... 7% 21.3M 6s 2024-09-14T21:24:53.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13100K .......... .......... .......... .......... .......... 7% 81.0M 6s 2024-09-14T21:24:53.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13150K .......... .......... .......... .......... .......... 7% 21.0M 6s 2024-09-14T21:24:53.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13200K .......... .......... .......... .......... .......... 7% 24.7M 6s 2024-09-14T21:24:53.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13250K .......... .......... .......... .......... .......... 7% 36.5M 6s 2024-09-14T21:24:53.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13300K .......... .......... .......... .......... .......... 7% 24.0M 6s 2024-09-14T21:24:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13350K .......... .......... .......... .......... .......... 7% 46.1M 6s 2024-09-14T21:24:53.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13400K .......... .......... .......... .......... .......... 7% 28.9M 6s 2024-09-14T21:24:53.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13450K .......... .......... .......... .......... .......... 8% 33.6M 6s 2024-09-14T21:24:53.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13500K .......... .......... .......... .......... .......... 8% 23.6M 6s 2024-09-14T21:24:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13550K .......... .......... .......... .......... .......... 8% 21.7M 6s 2024-09-14T21:24:53.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13600K .......... .......... .......... .......... .......... 8% 24.4M 6s 2024-09-14T21:24:53.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13650K .......... .......... .......... .......... .......... 8% 62.8M 6s 2024-09-14T21:24:53.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13700K .......... .......... .......... .......... .......... 8% 31.1M 6s 2024-09-14T21:24:53.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13750K .......... .......... .......... .......... .......... 8% 26.0M 6s 2024-09-14T21:24:53.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13800K .......... .......... .......... .......... .......... 8% 25.3M 6s 2024-09-14T21:24:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13850K .......... .......... .......... .......... .......... 8% 44.6M 6s 2024-09-14T21:24:53.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13900K .......... .......... .......... .......... .......... 8% 24.6M 6s 2024-09-14T21:24:53.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 13950K .......... .......... .......... .......... .......... 8% 23.8M 6s 2024-09-14T21:24:53.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14000K .......... .......... .......... .......... .......... 8% 42.3M 6s 2024-09-14T21:24:53.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14050K .......... .......... .......... .......... .......... 8% 21.6M 6s 2024-09-14T21:24:53.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14100K .......... .......... .......... .......... .......... 8% 33.2M 6s 2024-09-14T21:24:53.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14150K .......... .......... .......... .......... .......... 8% 41.3M 6s 2024-09-14T21:24:53.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14200K .......... .......... .......... .......... .......... 8% 27.7M 6s 2024-09-14T21:24:53.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14250K .......... .......... .......... .......... .......... 8% 43.1M 6s 2024-09-14T21:24:53.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14300K .......... .......... .......... .......... .......... 8% 19.8M 6s 2024-09-14T21:24:53.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14350K .......... .......... .......... .......... .......... 8% 26.5M 6s 2024-09-14T21:24:53.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14400K .......... .......... .......... .......... .......... 8% 34.9M 6s 2024-09-14T21:24:53.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14450K .......... .......... .......... .......... .......... 8% 23.9M 6s 2024-09-14T21:24:53.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14500K .......... .......... .......... .......... .......... 8% 41.2M 6s 2024-09-14T21:24:53.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14550K .......... .......... .......... .......... .......... 8% 24.3M 6s 2024-09-14T21:24:53.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14600K .......... .......... .......... .......... .......... 8% 51.3M 6s 2024-09-14T21:24:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14650K .......... .......... .......... .......... .......... 8% 21.8M 6s 2024-09-14T21:24:53.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14700K .......... .......... .......... .......... .......... 8% 44.0M 6s 2024-09-14T21:24:53.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14750K .......... .......... .......... .......... .......... 8% 22.1M 6s 2024-09-14T21:24:53.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14800K .......... .......... .......... .......... .......... 8% 23.5M 6s 2024-09-14T21:24:53.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14850K .......... .......... .......... .......... .......... 8% 24.5M 6s 2024-09-14T21:24:53.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14900K .......... .......... .......... .......... .......... 8% 53.7M 6s 2024-09-14T21:24:53.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 14950K .......... .......... .......... .......... .......... 8% 32.2M 6s 2024-09-14T21:24:53.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15000K .......... .......... .......... .......... .......... 8% 26.0M 6s 2024-09-14T21:24:53.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15050K .......... .......... .......... .......... .......... 8% 23.5M 6s 2024-09-14T21:24:53.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15100K .......... .......... .......... .......... .......... 8% 51.1M 6s 2024-09-14T21:24:53.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15150K .......... .......... .......... .......... .......... 9% 22.7M 6s 2024-09-14T21:24:53.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15200K .......... .......... .......... .......... .......... 9% 24.7M 6s 2024-09-14T21:24:53.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15250K .......... .......... .......... .......... .......... 9% 38.2M 6s 2024-09-14T21:24:53.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15300K .......... .......... .......... .......... .......... 9% 23.1M 6s 2024-09-14T21:24:53.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15350K .......... .......... .......... .......... .......... 9% 22.1M 6s 2024-09-14T21:24:53.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15400K .......... .......... .......... .......... .......... 9% 70.8M 6s 2024-09-14T21:24:53.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15450K .......... .......... .......... .......... .......... 9% 35.5M 6s 2024-09-14T21:24:53.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15500K .......... .......... .......... .......... .......... 9% 25.0M 6s 2024-09-14T21:24:53.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15550K .......... .......... .......... .......... .......... 9% 18.4M 6s 2024-09-14T21:24:53.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15600K .......... .......... .......... .......... .......... 9% 34.3M 6s 2024-09-14T21:24:53.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15650K .......... .......... .......... .......... .......... 9% 48.5M 6s 2024-09-14T21:24:53.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15700K .......... .......... .......... .......... .......... 9% 23.8M 6s 2024-09-14T21:24:53.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15750K .......... .......... .......... .......... .......... 9% 35.5M 6s 2024-09-14T21:24:53.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15800K .......... .......... .......... .......... .......... 9% 24.8M 6s 2024-09-14T21:24:53.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15850K .......... .......... .......... .......... .......... 9% 42.5M 6s 2024-09-14T21:24:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15900K .......... .......... .......... .......... .......... 9% 28.0M 6s 2024-09-14T21:24:53.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 15950K .......... .......... .......... .......... .......... 9% 24.5M 6s 2024-09-14T21:24:53.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16000K .......... .......... .......... .......... .......... 9% 31.0M 6s 2024-09-14T21:24:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16050K .......... .......... .......... .......... .......... 9% 23.2M 6s 2024-09-14T21:24:53.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16100K .......... .......... .......... .......... .......... 9% 25.9M 6s 2024-09-14T21:24:53.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16150K .......... .......... .......... .......... .......... 9% 53.9M 6s 2024-09-14T21:24:53.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16200K .......... .......... .......... .......... .......... 9% 22.9M 6s 2024-09-14T21:24:53.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16250K .......... .......... .......... .......... .......... 9% 43.8M 6s 2024-09-14T21:24:53.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16300K .......... .......... .......... .......... .......... 9% 20.1M 6s 2024-09-14T21:24:53.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16350K .......... .......... .......... .......... .......... 9% 24.3M 6s 2024-09-14T21:24:53.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16400K .......... .......... .......... .......... .......... 9% 60.5M 6s 2024-09-14T21:24:53.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16450K .......... .......... .......... .......... .......... 9% 29.0M 6s 2024-09-14T21:24:53.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16500K .......... .......... .......... .......... .......... 9% 24.7M 6s 2024-09-14T21:24:53.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16550K .......... .......... .......... .......... .......... 9% 24.7M 6s 2024-09-14T21:24:53.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16600K .......... .......... .......... .......... .......... 9% 29.0M 6s 2024-09-14T21:24:53.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16650K .......... .......... .......... .......... .......... 9% 46.3M 6s 2024-09-14T21:24:53.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16700K .......... .......... .......... .......... .......... 9% 23.2M 6s 2024-09-14T21:24:53.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16750K .......... .......... .......... .......... .......... 9% 25.7M 6s 2024-09-14T21:24:53.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16800K .......... .......... .......... .......... .......... 9% 28.6M 6s 2024-09-14T21:24:53.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16850K .......... .......... .......... .......... .......... 10% 26.5M 6s 2024-09-14T21:24:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16900K .......... .......... .......... .......... .......... 10% 44.9M 6s 2024-09-14T21:24:53.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 16950K .......... .......... .......... .......... .......... 10% 29.0M 6s 2024-09-14T21:24:53.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17000K .......... .......... .......... .......... .......... 10% 24.8M 6s 2024-09-14T21:24:53.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17050K .......... .......... .......... .......... .......... 10% 34.1M 6s 2024-09-14T21:24:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17100K .......... .......... .......... .......... .......... 10% 24.1M 6s 2024-09-14T21:24:53.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17150K .......... .......... .......... .......... .......... 10% 24.1M 6s 2024-09-14T21:24:53.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17200K .......... .......... .......... .......... .......... 10% 51.3M 6s 2024-09-14T21:24:53.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17250K .......... .......... .......... .......... .......... 10% 23.7M 6s 2024-09-14T21:24:53.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17300K .......... .......... .......... .......... .......... 10% 35.7M 6s 2024-09-14T21:24:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17350K .......... .......... .......... .......... .......... 10% 21.5M 6s 2024-09-14T21:24:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17400K .......... .......... .......... .......... .......... 10% 77.0M 6s 2024-09-14T21:24:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17450K .......... .......... .......... .......... .......... 10% 23.3M 6s 2024-09-14T21:24:53.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17500K .......... .......... .......... .......... .......... 10% 29.0M 6s 2024-09-14T21:24:53.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17550K .......... .......... .......... .......... .......... 10% 30.9M 6s 2024-09-14T21:24:53.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17600K .......... .......... .......... .......... .......... 10% 20.9M 6s 2024-09-14T21:24:53.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17650K .......... .......... .......... .......... .......... 10% 25.8M 6s 2024-09-14T21:24:53.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17700K .......... .......... .......... .......... .......... 10% 54.0M 6s 2024-09-14T21:24:53.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17750K .......... .......... .......... .......... .......... 10% 24.0M 6s 2024-09-14T21:24:53.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17800K .......... .......... .......... .......... .......... 10% 37.2M 6s 2024-09-14T21:24:53.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17850K .......... .......... .......... .......... .......... 10% 22.4M 6s 2024-09-14T21:24:53.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17900K .......... .......... .......... .......... .......... 10% 57.6M 6s 2024-09-14T21:24:53.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 17950K .......... .......... .......... .......... .......... 10% 27.7M 6s 2024-09-14T21:24:53.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18000K .......... .......... .......... .......... .......... 10% 22.3M 6s 2024-09-14T21:24:53.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18050K .......... .......... .......... .......... .......... 10% 32.1M 6s 2024-09-14T21:24:53.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18100K .......... .......... .......... .......... .......... 10% 34.9M 6s 2024-09-14T21:24:53.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18150K .......... .......... .......... .......... .......... 10% 18.9M 6s 2024-09-14T21:24:53.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18200K .......... .......... .......... .......... .......... 10% 46.7M 6s 2024-09-14T21:24:53.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18250K .......... .......... .......... .......... .......... 10% 45.4M 6s 2024-09-14T21:24:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18300K .......... .......... .......... .......... .......... 10% 20.3M 6s 2024-09-14T21:24:53.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18350K .......... .......... .......... .......... .......... 10% 24.5M 6s 2024-09-14T21:24:53.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18400K .......... .......... .......... .......... .......... 10% 24.8M 6s 2024-09-14T21:24:53.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18450K .......... .......... .......... .......... .......... 10% 58.4M 6s 2024-09-14T21:24:53.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18500K .......... .......... .......... .......... .......... 11% 25.3M 6s 2024-09-14T21:24:53.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18550K .......... .......... .......... .......... .......... 11% 30.5M 6s 2024-09-14T21:24:53.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18600K .......... .......... .......... .......... .......... 11% 28.2M 6s 2024-09-14T21:24:53.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18650K .......... .......... .......... .......... .......... 11% 30.9M 6s 2024-09-14T21:24:53.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18700K .......... .......... .......... .......... .......... 11% 45.1M 6s 2024-09-14T21:24:53.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18750K .......... .......... .......... .......... .......... 11% 19.8M 6s 2024-09-14T21:24:54.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18800K .......... .......... .......... .......... .......... 11% 38.5M 6s 2024-09-14T21:24:54.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18850K .......... .......... .......... .......... .......... 11% 23.3M 6s 2024-09-14T21:24:54.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18900K .......... .......... .......... .......... .......... 11% 24.0M 6s 2024-09-14T21:24:54.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 18950K .......... .......... .......... .......... .......... 11% 66.7M 6s 2024-09-14T21:24:54.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19000K .......... .......... .......... .......... .......... 11% 23.2M 6s 2024-09-14T21:24:54.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19050K .......... .......... .......... .......... .......... 11% 31.6M 6s 2024-09-14T21:24:54.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19100K .......... .......... .......... .......... .......... 11% 26.7M 6s 2024-09-14T21:24:54.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19150K .......... .......... .......... .......... .......... 11% 22.5M 6s 2024-09-14T21:24:54.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19200K .......... .......... .......... .......... .......... 11% 55.7M 6s 2024-09-14T21:24:54.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19250K .......... .......... .......... .......... .......... 11% 23.9M 6s 2024-09-14T21:24:54.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19300K .......... .......... .......... .......... .......... 11% 30.9M 6s 2024-09-14T21:24:54.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19350K .......... .......... .......... .......... .......... 11% 23.2M 6s 2024-09-14T21:24:54.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19400K .......... .......... .......... .......... .......... 11% 23.1M 6s 2024-09-14T21:24:54.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19450K .......... .......... .......... .......... .......... 11% 82.3M 6s 2024-09-14T21:24:54.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19500K .......... .......... .......... .......... .......... 11% 29.6M 6s 2024-09-14T21:24:54.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19550K .......... .......... .......... .......... .......... 11% 20.7M 6s 2024-09-14T21:24:54.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19600K .......... .......... .......... .......... .......... 11% 29.4M 6s 2024-09-14T21:24:54.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19650K .......... .......... .......... .......... .......... 11% 27.2M 6s 2024-09-14T21:24:54.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19700K .......... .......... .......... .......... .......... 11% 58.4M 6s 2024-09-14T21:24:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19750K .......... .......... .......... .......... .......... 11% 23.8M 6s 2024-09-14T21:24:54.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19800K .......... .......... .......... .......... .......... 11% 31.3M 6s 2024-09-14T21:24:54.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19850K .......... .......... .......... .......... .......... 11% 22.8M 6s 2024-09-14T21:24:54.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19900K .......... .......... .......... .......... .......... 11% 28.2M 6s 2024-09-14T21:24:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 19950K .......... .......... .......... .......... .......... 11% 21.6M 6s 2024-09-14T21:24:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20000K .......... .......... .......... .......... .......... 11% 86.1M 6s 2024-09-14T21:24:54.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20050K .......... .......... .......... .......... .......... 11% 24.1M 6s 2024-09-14T21:24:54.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20100K .......... .......... .......... .......... .......... 11% 31.8M 6s 2024-09-14T21:24:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20150K .......... .......... .......... .......... .......... 11% 25.5M 5s 2024-09-14T21:24:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20200K .......... .......... .......... .......... .......... 12% 51.7M 5s 2024-09-14T21:24:54.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20250K .......... .......... .......... .......... .......... 12% 24.4M 5s 2024-09-14T21:24:54.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20300K .......... .......... .......... .......... .......... 12% 33.8M 5s 2024-09-14T21:24:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20350K .......... .......... .......... .......... .......... 12% 25.3M 5s 2024-09-14T21:24:54.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20400K .......... .......... .......... .......... .......... 12% 22.4M 5s 2024-09-14T21:24:54.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20450K .......... .......... .......... .......... .......... 12% 25.4M 5s 2024-09-14T21:24:54.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20500K .......... .......... .......... .......... .......... 12% 56.2M 5s 2024-09-14T21:24:54.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20550K .......... .......... .......... .......... .......... 12% 26.4M 5s 2024-09-14T21:24:54.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20600K .......... .......... .......... .......... .......... 12% 29.9M 5s 2024-09-14T21:24:54.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20650K .......... .......... .......... .......... .......... 12% 23.9M 5s 2024-09-14T21:24:54.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20700K .......... .......... .......... .......... .......... 12% 57.8M 5s 2024-09-14T21:24:54.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20750K .......... .......... .......... .......... .......... 12% 23.5M 5s 2024-09-14T21:24:54.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20800K .......... .......... .......... .......... .......... 12% 24.8M 5s 2024-09-14T21:24:54.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20850K .......... .......... .......... .......... .......... 12% 36.9M 5s 2024-09-14T21:24:54.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20900K .......... .......... .......... .......... .......... 12% 27.3M 5s 2024-09-14T21:24:54.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 20950K .......... .......... .......... .......... .......... 12% 20.8M 5s 2024-09-14T21:24:54.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21000K .......... .......... .......... .......... .......... 12% 45.9M 5s 2024-09-14T21:24:54.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21050K .......... .......... .......... .......... .......... 12% 36.9M 5s 2024-09-14T21:24:54.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21100K .......... .......... .......... .......... .......... 12% 25.8M 5s 2024-09-14T21:24:54.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21150K .......... .......... .......... .......... .......... 12% 22.8M 5s 2024-09-14T21:24:54.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21200K .......... .......... .......... .......... .......... 12% 24.8M 5s 2024-09-14T21:24:54.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21250K .......... .......... .......... .......... .......... 12% 54.6M 5s 2024-09-14T21:24:54.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21300K .......... .......... .......... .......... .......... 12% 24.4M 5s 2024-09-14T21:24:54.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21350K .......... .......... .......... .......... .......... 12% 33.4M 5s 2024-09-14T21:24:54.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21400K .......... .......... .......... .......... .......... 12% 24.3M 5s 2024-09-14T21:24:54.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21450K .......... .......... .......... .......... .......... 12% 57.6M 5s 2024-09-14T21:24:54.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21500K .......... .......... .......... .......... .......... 12% 25.6M 5s 2024-09-14T21:24:54.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21550K .......... .......... .......... .......... .......... 12% 20.5M 5s 2024-09-14T21:24:54.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21600K .......... .......... .......... .......... .......... 12% 43.9M 5s 2024-09-14T21:24:54.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21650K .......... .......... .......... .......... .......... 12% 20.5M 5s 2024-09-14T21:24:54.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21700K .......... .......... .......... .......... .......... 12% 26.8M 5s 2024-09-14T21:24:54.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21750K .......... .......... .......... .......... .......... 12% 52.7M 5s 2024-09-14T21:24:54.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21800K .......... .......... .......... .......... .......... 12% 25.0M 5s 2024-09-14T21:24:54.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21850K .......... .......... .......... .......... .......... 12% 32.6M 5s 2024-09-14T21:24:54.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21900K .......... .......... .......... .......... .......... 13% 26.6M 5s 2024-09-14T21:24:54.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 21950K .......... .......... .......... .......... .......... 13% 21.5M 5s 2024-09-14T21:24:54.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22000K .......... .......... .......... .......... .......... 13% 66.2M 5s 2024-09-14T21:24:54.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22050K .......... .......... .......... .......... .......... 13% 21.9M 5s 2024-09-14T21:24:54.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22100K .......... .......... .......... .......... .......... 13% 43.4M 5s 2024-09-14T21:24:54.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22150K .......... .......... .......... .......... .......... 13% 18.3M 5s 2024-09-14T21:24:54.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22200K .......... .......... .......... .......... .......... 13% 33.2M 5s 2024-09-14T21:24:54.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22250K .......... .......... .......... .......... .......... 13% 36.9M 5s 2024-09-14T21:24:54.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22300K .......... .......... .......... .......... .......... 13% 29.3M 5s 2024-09-14T21:24:54.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22350K .......... .......... .......... .......... .......... 13% 22.7M 5s 2024-09-14T21:24:54.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22400K .......... .......... .......... .......... .......... 13% 37.9M 5s 2024-09-14T21:24:54.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22450K .......... .......... .......... .......... .......... 13% 23.0M 5s 2024-09-14T21:24:54.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22500K .......... .......... .......... .......... .......... 13% 63.9M 5s 2024-09-14T21:24:54.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22550K .......... .......... .......... .......... .......... 13% 23.6M 5s 2024-09-14T21:24:54.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22600K .......... .......... .......... .......... .......... 13% 36.5M 5s 2024-09-14T21:24:54.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22650K .......... .......... .......... .......... .......... 13% 24.5M 5s 2024-09-14T21:24:54.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22700K .......... .......... .......... .......... .......... 13% 22.6M 5s 2024-09-14T21:24:54.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22750K .......... .......... .......... .......... .......... 13% 25.4M 5s 2024-09-14T21:24:54.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22800K .......... .......... .......... .......... .......... 13% 56.9M 5s 2024-09-14T21:24:54.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22850K .......... .......... .......... .......... .......... 13% 26.2M 5s 2024-09-14T21:24:54.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22900K .......... .......... .......... .......... .......... 13% 29.8M 5s 2024-09-14T21:24:54.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 22950K .......... .......... .......... .......... .......... 13% 25.5M 5s 2024-09-14T21:24:54.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23000K .......... .......... .......... .......... .......... 13% 37.2M 5s 2024-09-14T21:24:54.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23050K .......... .......... .......... .......... .......... 13% 28.2M 5s 2024-09-14T21:24:54.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23100K .......... .......... .......... .......... .......... 13% 30.7M 5s 2024-09-14T21:24:54.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23150K .......... .......... .......... .......... .......... 13% 24.7M 5s 2024-09-14T21:24:54.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23200K .......... .......... .......... .......... .......... 13% 27.0M 5s 2024-09-14T21:24:54.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23250K .......... .......... .......... .......... .......... 13% 31.7M 5s 2024-09-14T21:24:54.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23300K .......... .......... .......... .......... .......... 13% 36.4M 5s 2024-09-14T21:24:54.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23350K .......... .......... .......... .......... .......... 13% 29.5M 5s 2024-09-14T21:24:54.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23400K .......... .......... .......... .......... .......... 13% 23.5M 5s 2024-09-14T21:24:54.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23450K .......... .......... .......... .......... .......... 13% 24.6M 5s 2024-09-14T21:24:54.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23500K .......... .......... .......... .......... .......... 13% 61.6M 5s 2024-09-14T21:24:54.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23550K .......... .......... .......... .......... .......... 14% 23.7M 5s 2024-09-14T21:24:54.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23600K .......... .......... .......... .......... .......... 14% 23.6M 5s 2024-09-14T21:24:54.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23650K .......... .......... .......... .......... .......... 14% 31.5M 5s 2024-09-14T21:24:54.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23700K .......... .......... .......... .......... .......... 14% 29.9M 5s 2024-09-14T21:24:54.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23750K .......... .......... .......... .......... .......... 14% 36.4M 5s 2024-09-14T21:24:54.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23800K .......... .......... .......... .......... .......... 14% 23.6M 5s 2024-09-14T21:24:54.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23850K .......... .......... .......... .......... .......... 14% 45.5M 5s 2024-09-14T21:24:54.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23900K .......... .......... .......... .......... .......... 14% 24.1M 5s 2024-09-14T21:24:54.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 23950K .......... .......... .......... .......... .......... 14% 24.2M 5s 2024-09-14T21:24:54.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24000K .......... .......... .......... .......... .......... 14% 23.0M 5s 2024-09-14T21:24:54.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24050K .......... .......... .......... .......... .......... 14% 55.2M 5s 2024-09-14T21:24:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24100K .......... .......... .......... .......... .......... 14% 25.4M 5s 2024-09-14T21:24:54.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24150K .......... .......... .......... .......... .......... 14% 32.2M 5s 2024-09-14T21:24:54.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24200K .......... .......... .......... .......... .......... 14% 22.6M 5s 2024-09-14T21:24:54.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24250K .......... .......... .......... .......... .......... 14% 65.1M 5s 2024-09-14T21:24:54.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24300K .......... .......... .......... .......... .......... 14% 22.8M 5s 2024-09-14T21:24:54.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24350K .......... .......... .......... .......... .......... 14% 26.2M 5s 2024-09-14T21:24:54.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24400K .......... .......... .......... .......... .......... 14% 28.6M 5s 2024-09-14T21:24:54.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24450K .......... .......... .......... .......... .......... 14% 26.4M 5s 2024-09-14T21:24:54.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24500K .......... .......... .......... .......... .......... 14% 24.1M 5s 2024-09-14T21:24:54.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24550K .......... .......... .......... .......... .......... 14% 63.2M 5s 2024-09-14T21:24:54.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24600K .......... .......... .......... .......... .......... 14% 21.0M 5s 2024-09-14T21:24:54.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24650K .......... .......... .......... .......... .......... 14% 54.3M 5s 2024-09-14T21:24:54.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24700K .......... .......... .......... .......... .......... 14% 22.1M 5s 2024-09-14T21:24:54.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24750K .......... .......... .......... .......... .......... 14% 24.1M 5s 2024-09-14T21:24:54.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24800K .......... .......... .......... .......... .......... 14% 41.1M 5s 2024-09-14T21:24:54.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24850K .......... .......... .......... .......... .......... 14% 27.8M 5s 2024-09-14T21:24:54.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24900K .......... .......... .......... .......... .......... 14% 24.1M 5s 2024-09-14T21:24:54.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 24950K .......... .......... .......... .......... .......... 14% 35.2M 5s 2024-09-14T21:24:54.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25000K .......... .......... .......... .......... .......... 14% 22.5M 5s 2024-09-14T21:24:54.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25050K .......... .......... .......... .......... .......... 14% 71.7M 5s 2024-09-14T21:24:54.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25100K .......... .......... .......... .......... .......... 14% 22.8M 5s 2024-09-14T21:24:54.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25150K .......... .......... .......... .......... .......... 14% 25.3M 5s 2024-09-14T21:24:54.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25200K .......... .......... .......... .......... .......... 14% 33.8M 5s 2024-09-14T21:24:54.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25250K .......... .......... .......... .......... .......... 15% 20.5M 5s 2024-09-14T21:24:54.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25300K .......... .......... .......... .......... .......... 15% 88.0M 5s 2024-09-14T21:24:54.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25350K .......... .......... .......... .......... .......... 15% 22.4M 5s 2024-09-14T21:24:54.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25400K .......... .......... .......... .......... .......... 15% 40.5M 5s 2024-09-14T21:24:54.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25450K .......... .......... .......... .......... .......... 15% 25.0M 5s 2024-09-14T21:24:54.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25500K .......... .......... .......... .......... .......... 15% 22.3M 5s 2024-09-14T21:24:54.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25550K .......... .......... .......... .......... .......... 15% 23.5M 5s 2024-09-14T21:24:54.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25600K .......... .......... .......... .......... .......... 15% 61.3M 5s 2024-09-14T21:24:54.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25650K .......... .......... .......... .......... .......... 15% 32.8M 5s 2024-09-14T21:24:54.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25700K .......... .......... .......... .......... .......... 15% 23.1M 5s 2024-09-14T21:24:54.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25750K .......... .......... .......... .......... .......... 15% 42.9M 5s 2024-09-14T21:24:54.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25800K .......... .......... .......... .......... .......... 15% 32.9M 5s 2024-09-14T21:24:54.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25850K .......... .......... .......... .......... .......... 15% 24.8M 5s 2024-09-14T21:24:54.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25900K .......... .......... .......... .......... .......... 15% 25.9M 5s 2024-09-14T21:24:54.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 25950K .......... .......... .......... .......... .......... 15% 28.4M 5s 2024-09-14T21:24:54.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26000K .......... .......... .......... .......... .......... 15% 29.7M 5s 2024-09-14T21:24:54.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26050K .......... .......... .......... .......... .......... 15% 19.8M 5s 2024-09-14T21:24:54.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26100K .......... .......... .......... .......... .......... 15% 70.5M 5s 2024-09-14T21:24:54.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26150K .......... .......... .......... .......... .......... 15% 22.8M 5s 2024-09-14T21:24:54.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26200K .......... .......... .......... .......... .......... 15% 37.9M 5s 2024-09-14T21:24:54.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26250K .......... .......... .......... .......... .......... 15% 21.7M 5s 2024-09-14T21:24:54.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26300K .......... .......... .......... .......... .......... 15% 46.5M 5s 2024-09-14T21:24:54.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26350K .......... .......... .......... .......... .......... 15% 27.4M 5s 2024-09-14T21:24:54.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26400K .......... .......... .......... .......... .......... 15% 23.6M 5s 2024-09-14T21:24:54.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26450K .......... .......... .......... .......... .......... 15% 35.1M 5s 2024-09-14T21:24:54.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26500K .......... .......... .......... .......... .......... 15% 24.1M 5s 2024-09-14T21:24:54.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26550K .......... .......... .......... .......... .......... 15% 48.8M 5s 2024-09-14T21:24:54.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26600K .......... .......... .......... .......... .......... 15% 26.6M 5s 2024-09-14T21:24:54.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26650K .......... .......... .......... .......... .......... 15% 33.5M 5s 2024-09-14T21:24:54.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26700K .......... .......... .......... .......... .......... 15% 24.5M 5s 2024-09-14T21:24:54.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26750K .......... .......... .......... .......... .......... 15% 20.7M 5s 2024-09-14T21:24:54.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26800K .......... .......... .......... .......... .......... 15% 25.8M 5s 2024-09-14T21:24:54.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26850K .......... .......... .......... .......... .......... 15% 53.0M 5s 2024-09-14T21:24:54.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26900K .......... .......... .......... .......... .......... 15% 22.5M 5s 2024-09-14T21:24:54.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 26950K .......... .......... .......... .......... .......... 16% 36.1M 5s 2024-09-14T21:24:54.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27000K .......... .......... .......... .......... .......... 16% 26.3M 5s 2024-09-14T21:24:54.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27050K .......... .......... .......... .......... .......... 16% 48.8M 5s 2024-09-14T21:24:54.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27100K .......... .......... .......... .......... .......... 16% 25.6M 5s 2024-09-14T21:24:54.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27150K .......... .......... .......... .......... .......... 16% 22.8M 5s 2024-09-14T21:24:54.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27200K .......... .......... .......... .......... .......... 16% 34.4M 5s 2024-09-14T21:24:54.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27250K .......... .......... .......... .......... .......... 16% 19.9M 5s 2024-09-14T21:24:54.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27300K .......... .......... .......... .......... .......... 16% 28.4M 5s 2024-09-14T21:24:54.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27350K .......... .......... .......... .......... .......... 16% 53.6M 5s 2024-09-14T21:24:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27400K .......... .......... .......... .......... .......... 16% 23.5M 5s 2024-09-14T21:24:54.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27450K .......... .......... .......... .......... .......... 16% 59.5M 5s 2024-09-14T21:24:54.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27500K .......... .......... .......... .......... .......... 16% 21.2M 5s 2024-09-14T21:24:54.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27550K .......... .......... .......... .......... .......... 16% 24.5M 5s 2024-09-14T21:24:54.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27600K .......... .......... .......... .......... .......... 16% 52.5M 5s 2024-09-14T21:24:54.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27650K .......... .......... .......... .......... .......... 16% 25.2M 5s 2024-09-14T21:24:54.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27700K .......... .......... .......... .......... .......... 16% 35.1M 5s 2024-09-14T21:24:54.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27750K .......... .......... .......... .......... .......... 16% 21.4M 5s 2024-09-14T21:24:54.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27800K .......... .......... .......... .......... .......... 16% 23.7M 5s 2024-09-14T21:24:54.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27850K .......... .......... .......... .......... .......... 16% 78.7M 5s 2024-09-14T21:24:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27900K .......... .......... .......... .......... .......... 16% 29.9M 5s 2024-09-14T21:24:54.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 27950K .......... .......... .......... .......... .......... 16% 18.8M 5s 2024-09-14T21:24:54.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28000K .......... .......... .......... .......... .......... 16% 54.6M 5s 2024-09-14T21:24:54.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28050K .......... .......... .......... .......... .......... 16% 20.8M 5s 2024-09-14T21:24:54.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28100K .......... .......... .......... .......... .......... 16% 51.8M 5s 2024-09-14T21:24:54.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28150K .......... .......... .......... .......... .......... 16% 23.7M 5s 2024-09-14T21:24:54.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28200K .......... .......... .......... .......... .......... 16% 34.2M 5s 2024-09-14T21:24:54.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28250K .......... .......... .......... .......... .......... 16% 23.8M 5s 2024-09-14T21:24:54.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28300K .......... .......... .......... .......... .......... 16% 42.3M 5s 2024-09-14T21:24:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28350K .......... .......... .......... .......... .......... 16% 22.3M 5s 2024-09-14T21:24:54.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28400K .......... .......... .......... .......... .......... 16% 28.2M 5s 2024-09-14T21:24:54.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28450K .......... .......... .......... .......... .......... 16% 38.8M 5s 2024-09-14T21:24:54.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28500K .......... .......... .......... .......... .......... 16% 18.5M 5s 2024-09-14T21:24:54.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28550K .......... .......... .......... .......... .......... 16% 87.0M 5s 2024-09-14T21:24:54.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28600K .......... .......... .......... .......... .......... 16% 29.8M 5s 2024-09-14T21:24:54.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28650K .......... .......... .......... .......... .......... 17% 21.4M 5s 2024-09-14T21:24:54.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28700K .......... .......... .......... .......... .......... 17% 43.0M 5s 2024-09-14T21:24:54.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28750K .......... .......... .......... .......... .......... 17% 19.5M 5s 2024-09-14T21:24:54.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28800K .......... .......... .......... .......... .......... 17% 25.9M 5s 2024-09-14T21:24:54.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28850K .......... .......... .......... .......... .......... 17% 56.9M 5s 2024-09-14T21:24:54.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28900K .......... .......... .......... .......... .......... 17% 21.0M 5s 2024-09-14T21:24:54.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 28950K .......... .......... .......... .......... .......... 17% 12.2M 5s 2024-09-14T21:24:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29000K .......... .......... .......... .......... .......... 17% 158M 5s 2024-09-14T21:24:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29050K .......... .......... .......... .......... .......... 17% 32.5M 5s 2024-09-14T21:24:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29100K .......... .......... .......... .......... .......... 17% 101M 5s 2024-09-14T21:24:54.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29150K .......... .......... .......... .......... .......... 17% 23.6M 5s 2024-09-14T21:24:54.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29200K .......... .......... .......... .......... .......... 17% 25.5M 5s 2024-09-14T21:24:54.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29250K .......... .......... .......... .......... .......... 17% 41.0M 5s 2024-09-14T21:24:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29300K .......... .......... .......... .......... .......... 17% 27.6M 5s 2024-09-14T21:24:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29350K .......... .......... .......... .......... .......... 17% 46.0M 5s 2024-09-14T21:24:54.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29400K .......... .......... .......... .......... .......... 17% 24.4M 5s 2024-09-14T21:24:54.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29450K .......... .......... .......... .......... .......... 17% 29.2M 5s 2024-09-14T21:24:54.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29500K .......... .......... .......... .......... .......... 17% 28.2M 5s 2024-09-14T21:24:54.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29550K .......... .......... .......... .......... .......... 17% 19.9M 5s 2024-09-14T21:24:54.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29600K .......... .......... .......... .......... .......... 17% 24.0M 5s 2024-09-14T21:24:54.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29650K .......... .......... .......... .......... .......... 17% 95.1M 5s 2024-09-14T21:24:54.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29700K .......... .......... .......... .......... .......... 17% 22.8M 5s 2024-09-14T21:24:54.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29750K .......... .......... .......... .......... .......... 17% 36.6M 5s 2024-09-14T21:24:54.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29800K .......... .......... .......... .......... .......... 17% 46.8M 5s 2024-09-14T21:24:54.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29850K .......... .......... .......... .......... .......... 17% 26.6M 5s 2024-09-14T21:24:54.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29900K .......... .......... .......... .......... .......... 17% 23.8M 5s 2024-09-14T21:24:54.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 29950K .......... .......... .......... .......... .......... 17% 22.7M 5s 2024-09-14T21:24:54.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30000K .......... .......... .......... .......... .......... 17% 39.2M 5s 2024-09-14T21:24:54.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30050K .......... .......... .......... .......... .......... 17% 23.0M 5s 2024-09-14T21:24:54.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30100K .......... .......... .......... .......... .......... 17% 27.3M 5s 2024-09-14T21:24:54.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30150K .......... .......... .......... .......... .......... 17% 38.9M 5s 2024-09-14T21:24:54.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30200K .......... .......... .......... .......... .......... 17% 22.0M 5s 2024-09-14T21:24:54.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30250K .......... .......... .......... .......... .......... 17% 36.4M 5s 2024-09-14T21:24:54.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30300K .......... .......... .......... .......... .......... 18% 25.6M 5s 2024-09-14T21:24:54.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30350K .......... .......... .......... .......... .......... 18% 25.8M 5s 2024-09-14T21:24:54.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30400K .......... .......... .......... .......... .......... 18% 43.6M 5s 2024-09-14T21:24:54.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30450K .......... .......... .......... .......... .......... 18% 23.5M 5s 2024-09-14T21:24:54.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30500K .......... .......... .......... .......... .......... 18% 42.9M 5s 2024-09-14T21:24:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30550K .......... .......... .......... .......... .......... 18% 22.5M 5s 2024-09-14T21:24:54.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30600K .......... .......... .......... .......... .......... 18% 23.7M 5s 2024-09-14T21:24:54.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30650K .......... .......... .......... .......... .......... 18% 66.7M 5s 2024-09-14T21:24:54.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30700K .......... .......... .......... .......... .......... 18% 36.2M 5s 2024-09-14T21:24:54.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30750K .......... .......... .......... .......... .......... 18% 23.2M 5s 2024-09-14T21:24:54.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30800K .......... .......... .......... .......... .......... 18% 22.8M 5s 2024-09-14T21:24:54.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30850K .......... .......... .......... .......... .......... 18% 24.7M 5s 2024-09-14T21:24:54.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30900K .......... .......... .......... .......... .......... 18% 52.6M 5s 2024-09-14T21:24:54.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 30950K .......... .......... .......... .......... .......... 18% 21.1M 5s 2024-09-14T21:24:54.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31000K .......... .......... .......... .......... .......... 18% 44.8M 5s 2024-09-14T21:24:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31050K .......... .......... .......... .......... .......... 18% 21.9M 5s 2024-09-14T21:24:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31100K .......... .......... .......... .......... .......... 18% 66.5M 5s 2024-09-14T21:24:54.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31150K .......... .......... .......... .......... .......... 18% 15.5M 5s 2024-09-14T21:24:54.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31200K .......... .......... .......... .......... .......... 18% 49.6M 5s 2024-09-14T21:24:54.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31250K .......... .......... .......... .......... .......... 18% 32.0M 5s 2024-09-14T21:24:54.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31300K .......... .......... .......... .......... .......... 18% 22.5M 5s 2024-09-14T21:24:54.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31350K .......... .......... .......... .......... .......... 18% 29.2M 5s 2024-09-14T21:24:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31400K .......... .......... .......... .......... .......... 18% 41.5M 5s 2024-09-14T21:24:54.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31450K .......... .......... .......... .......... .......... 18% 27.0M 5s 2024-09-14T21:24:54.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31500K .......... .......... .......... .......... .......... 18% 37.0M 5s 2024-09-14T21:24:54.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31550K .......... .......... .......... .......... .......... 18% 22.0M 5s 2024-09-14T21:24:54.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31600K .......... .......... .......... .......... .......... 18% 25.6M 5s 2024-09-14T21:24:54.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31650K .......... .......... .......... .......... .......... 18% 59.4M 5s 2024-09-14T21:24:54.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31700K .......... .......... .......... .......... .......... 18% 24.4M 5s 2024-09-14T21:24:54.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31750K .......... .......... .......... .......... .......... 18% 33.1M 5s 2024-09-14T21:24:54.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31800K .......... .......... .......... .......... .......... 18% 24.7M 5s 2024-09-14T21:24:54.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31850K .......... .......... .......... .......... .......... 18% 23.1M 5s 2024-09-14T21:24:54.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31900K .......... .......... .......... .......... .......... 18% 70.1M 5s 2024-09-14T21:24:54.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 31950K .......... .......... .......... .......... .......... 18% 23.1M 5s 2024-09-14T21:24:54.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32000K .......... .......... .......... .......... .......... 19% 24.3M 5s 2024-09-14T21:24:54.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32050K .......... .......... .......... .......... .......... 19% 27.7M 5s 2024-09-14T21:24:54.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32100K .......... .......... .......... .......... .......... 19% 28.7M 5s 2024-09-14T21:24:54.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32150K .......... .......... .......... .......... .......... 19% 55.9M 5s 2024-09-14T21:24:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32200K .......... .......... .......... .......... .......... 19% 23.7M 5s 2024-09-14T21:24:54.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32250K .......... .......... .......... .......... .......... 19% 36.0M 5s 2024-09-14T21:24:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32300K .......... .......... .......... .......... .......... 19% 23.4M 5s 2024-09-14T21:24:54.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32350K .......... .......... .......... .......... .......... 19% 31.7M 5s 2024-09-14T21:24:54.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32400K .......... .......... .......... .......... .......... 19% 28.0M 5s 2024-09-14T21:24:54.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32450K .......... .......... .......... .......... .......... 19% 29.4M 5s 2024-09-14T21:24:54.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32500K .......... .......... .......... .......... .......... 19% 22.6M 5s 2024-09-14T21:24:54.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32550K .......... .......... .......... .......... .......... 19% 62.2M 5s 2024-09-14T21:24:54.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32600K .......... .......... .......... .......... .......... 19% 20.7M 5s 2024-09-14T21:24:54.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32650K .......... .......... .......... .......... .......... 19% 51.7M 5s 2024-09-14T21:24:54.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32700K .......... .......... .......... .......... .......... 19% 21.0M 5s 2024-09-14T21:24:54.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32750K .......... .......... .......... .......... .......... 19% 22.9M 5s 2024-09-14T21:24:54.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32800K .......... .......... .......... .......... .......... 19% 47.3M 5s 2024-09-14T21:24:54.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32850K .......... .......... .......... .......... .......... 19% 21.7M 5s 2024-09-14T21:24:54.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32900K .......... .......... .......... .......... .......... 19% 29.6M 5s 2024-09-14T21:24:54.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 32950K .......... .......... .......... .......... .......... 19% 35.7M 5s 2024-09-14T21:24:54.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33000K .......... .......... .......... .......... .......... 19% 44.1M 5s 2024-09-14T21:24:54.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33050K .......... .......... .......... .......... .......... 19% 24.7M 5s 2024-09-14T21:24:54.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33100K .......... .......... .......... .......... .......... 19% 24.9M 5s 2024-09-14T21:24:54.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33150K .......... .......... .......... .......... .......... 19% 21.9M 5s 2024-09-14T21:24:54.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33200K .......... .......... .......... .......... .......... 19% 53.6M 5s 2024-09-14T21:24:54.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33250K .......... .......... .......... .......... .......... 19% 24.8M 5s 2024-09-14T21:24:54.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33300K .......... .......... .......... .......... .......... 19% 37.3M 5s 2024-09-14T21:24:54.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33350K .......... .......... .......... .......... .......... 19% 22.8M 5s 2024-09-14T21:24:54.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33400K .......... .......... .......... .......... .......... 19% 44.9M 5s 2024-09-14T21:24:54.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33450K .......... .......... .......... .......... .......... 19% 27.5M 5s 2024-09-14T21:24:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33500K .......... .......... .......... .......... .......... 19% 33.7M 5s 2024-09-14T21:24:54.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33550K .......... .......... .......... .......... .......... 19% 22.5M 5s 2024-09-14T21:24:54.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33600K .......... .......... .......... .......... .......... 19% 26.1M 5s 2024-09-14T21:24:54.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33650K .......... .......... .......... .......... .......... 19% 32.4M 5s 2024-09-14T21:24:54.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33700K .......... .......... .......... .......... .......... 20% 32.4M 5s 2024-09-14T21:24:54.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33750K .......... .......... .......... .......... .......... 20% 28.2M 5s 2024-09-14T21:24:54.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33800K .......... .......... .......... .......... .......... 20% 31.0M 5s 2024-09-14T21:24:54.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33850K .......... .......... .......... .......... .......... 20% 26.1M 5s 2024-09-14T21:24:54.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33900K .......... .......... .......... .......... .......... 20% 39.8M 5s 2024-09-14T21:24:54.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 33950K .......... .......... .......... .......... .......... 20% 26.0M 5s 2024-09-14T21:24:54.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34000K .......... .......... .......... .......... .......... 20% 20.9M 5s 2024-09-14T21:24:54.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34050K .......... .......... .......... .......... .......... 20% 26.2M 5s 2024-09-14T21:24:54.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34100K .......... .......... .......... .......... .......... 20% 38.3M 5s 2024-09-14T21:24:54.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34150K .......... .......... .......... .......... .......... 20% 24.7M 5s 2024-09-14T21:24:54.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34200K .......... .......... .......... .......... .......... 20% 35.7M 5s 2024-09-14T21:24:54.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34250K .......... .......... .......... .......... .......... 20% 24.4M 5s 2024-09-14T21:24:54.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34300K .......... .......... .......... .......... .......... 20% 51.2M 5s 2024-09-14T21:24:54.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34350K .......... .......... .......... .......... .......... 20% 18.2M 5s 2024-09-14T21:24:54.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34400K .......... .......... .......... .......... .......... 20% 37.3M 5s 2024-09-14T21:24:54.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34450K .......... .......... .......... .......... .......... 20% 49.9M 5s 2024-09-14T21:24:54.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34500K .......... .......... .......... .......... .......... 20% 24.9M 5s 2024-09-14T21:24:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34550K .......... .......... .......... .......... .......... 20% 23.7M 5s 2024-09-14T21:24:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34600K .......... .......... .......... .......... .......... 20% 41.0M 5s 2024-09-14T21:24:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34650K .......... .......... .......... .......... .......... 20% 22.8M 5s 2024-09-14T21:24:54.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34700K .......... .......... .......... .......... .......... 20% 40.3M 5s 2024-09-14T21:24:54.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34750K .......... .......... .......... .......... .......... 20% 25.0M 5s 2024-09-14T21:24:54.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34800K .......... .......... .......... .......... .......... 20% 23.3M 5s 2024-09-14T21:24:54.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34850K .......... .......... .......... .......... .......... 20% 34.5M 5s 2024-09-14T21:24:54.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34900K .......... .......... .......... .......... .......... 20% 26.9M 5s 2024-09-14T21:24:54.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 34950K .......... .......... .......... .......... .......... 20% 45.9M 5s 2024-09-14T21:24:54.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35000K .......... .......... .......... .......... .......... 20% 25.3M 5s 2024-09-14T21:24:54.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35050K .......... .......... .......... .......... .......... 20% 34.2M 5s 2024-09-14T21:24:54.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35100K .......... .......... .......... .......... .......... 20% 28.0M 5s 2024-09-14T21:24:54.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35150K .......... .......... .......... .......... .......... 20% 23.7M 5s 2024-09-14T21:24:54.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35200K .......... .......... .......... .......... .......... 20% 26.1M 5s 2024-09-14T21:24:54.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35250K .......... .......... .......... .......... .......... 20% 32.1M 5s 2024-09-14T21:24:54.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35300K .......... .......... .......... .......... .......... 20% 27.0M 5s 2024-09-14T21:24:54.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35350K .......... .......... .......... .......... .......... 21% 29.3M 5s 2024-09-14T21:24:54.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35400K .......... .......... .......... .......... .......... 21% 29.1M 5s 2024-09-14T21:24:54.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35450K .......... .......... .......... .......... .......... 21% 53.9M 5s 2024-09-14T21:24:54.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35500K .......... .......... .......... .......... .......... 21% 22.4M 5s 2024-09-14T21:24:54.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35550K .......... .......... .......... .......... .......... 21% 24.6M 5s 2024-09-14T21:24:54.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35600K .......... .......... .......... .......... .......... 21% 29.5M 5s 2024-09-14T21:24:54.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35650K .......... .......... .......... .......... .......... 21% 27.8M 5s 2024-09-14T21:24:54.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35700K .......... .......... .......... .......... .......... 21% 23.9M 5s 2024-09-14T21:24:54.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35750K .......... .......... .......... .......... .......... 21% 67.4M 5s 2024-09-14T21:24:54.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35800K .......... .......... .......... .......... .......... 21% 33.0M 5s 2024-09-14T21:24:54.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35850K .......... .......... .......... .......... .......... 21% 22.5M 5s 2024-09-14T21:24:54.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35900K .......... .......... .......... .......... .......... 21% 34.0M 5s 2024-09-14T21:24:54.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 35950K .......... .......... .......... .......... .......... 21% 19.3M 5s 2024-09-14T21:24:54.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36000K .......... .......... .......... .......... .......... 21% 60.8M 5s 2024-09-14T21:24:54.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36050K .......... .......... .......... .......... .......... 21% 23.1M 5s 2024-09-14T21:24:54.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36100K .......... .......... .......... .......... .......... 21% 34.8M 5s 2024-09-14T21:24:54.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36150K .......... .......... .......... .......... .......... 21% 22.8M 5s 2024-09-14T21:24:54.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36200K .......... .......... .......... .......... .......... 21% 64.6M 5s 2024-09-14T21:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36250K .......... .......... .......... .......... .......... 21% 24.5M 5s 2024-09-14T21:24:54.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36300K .......... .......... .......... .......... .......... 21% 34.1M 5s 2024-09-14T21:24:54.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36350K .......... .......... .......... .......... .......... 21% 23.4M 5s 2024-09-14T21:24:54.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36400K .......... .......... .......... .......... .......... 21% 24.0M 5s 2024-09-14T21:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36450K .......... .......... .......... .......... .......... 21% 25.5M 5s 2024-09-14T21:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36500K .......... .......... .......... .......... .......... 21% 51.3M 5s 2024-09-14T21:24:54.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36550K .......... .......... .......... .......... .......... 21% 24.9M 5s 2024-09-14T21:24:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36600K .......... .......... .......... .......... .......... 21% 32.7M 5s 2024-09-14T21:24:54.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36650K .......... .......... .......... .......... .......... 21% 26.3M 5s 2024-09-14T21:24:54.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36700K .......... .......... .......... .......... .......... 21% 50.3M 5s 2024-09-14T21:24:54.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36750K .......... .......... .......... .......... .......... 21% 23.7M 5s 2024-09-14T21:24:54.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36800K .......... .......... .......... .......... .......... 21% 27.2M 5s 2024-09-14T21:24:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36850K .......... .......... .......... .......... .......... 21% 26.4M 5s 2024-09-14T21:24:54.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36900K .......... .......... .......... .......... .......... 21% 27.6M 5s 2024-09-14T21:24:54.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 36950K .......... .......... .......... .......... .......... 21% 28.2M 5s 2024-09-14T21:24:54.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37000K .......... .......... .......... .......... .......... 21% 35.0M 5s 2024-09-14T21:24:54.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37050K .......... .......... .......... .......... .......... 22% 22.0M 5s 2024-09-14T21:24:54.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37100K .......... .......... .......... .......... .......... 22% 49.7M 5s 2024-09-14T21:24:54.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37150K .......... .......... .......... .......... .......... 22% 23.8M 5s 2024-09-14T21:24:54.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37200K .......... .......... .......... .......... .......... 22% 26.2M 5s 2024-09-14T21:24:54.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37250K .......... .......... .......... .......... .......... 22% 43.9M 5s 2024-09-14T21:24:54.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37300K .......... .......... .......... .......... .......... 22% 25.5M 5s 2024-09-14T21:24:54.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37350K .......... .......... .......... .......... .......... 22% 33.8M 5s 2024-09-14T21:24:54.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37400K .......... .......... .......... .......... .......... 22% 21.9M 5s 2024-09-14T21:24:54.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37450K .......... .......... .......... .......... .......... 22% 32.7M 5s 2024-09-14T21:24:54.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37500K .......... .......... .......... .......... .......... 22% 36.8M 5s 2024-09-14T21:24:54.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37550K .......... .......... .......... .......... .......... 22% 25.5M 5s 2024-09-14T21:24:54.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37600K .......... .......... .......... .......... .......... 22% 21.7M 5s 2024-09-14T21:24:54.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37650K .......... .......... .......... .......... .......... 22% 34.2M 5s 2024-09-14T21:24:54.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37700K .......... .......... .......... .......... .......... 22% 26.3M 5s 2024-09-14T21:24:54.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37750K .......... .......... .......... .......... .......... 22% 46.7M 5s 2024-09-14T21:24:54.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37800K .......... .......... .......... .......... .......... 22% 24.4M 5s 2024-09-14T21:24:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37850K .......... .......... .......... .......... .......... 22% 22.9M 5s 2024-09-14T21:24:54.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37900K .......... .......... .......... .......... .......... 22% 35.3M 5s 2024-09-14T21:24:54.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 37950K .......... .......... .......... .......... .......... 22% 26.4M 5s 2024-09-14T21:24:54.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38000K .......... .......... .......... .......... .......... 22% 22.3M 5s 2024-09-14T21:24:54.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38050K .......... .......... .......... .......... .......... 22% 56.1M 5s 2024-09-14T21:24:54.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38100K .......... .......... .......... .......... .......... 22% 29.5M 5s 2024-09-14T21:24:54.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38150K .......... .......... .......... .......... .......... 22% 24.7M 5s 2024-09-14T21:24:54.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38200K .......... .......... .......... .......... .......... 22% 24.0M 5s 2024-09-14T21:24:54.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38250K .......... .......... .......... .......... .......... 22% 61.3M 5s 2024-09-14T21:24:54.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38300K .......... .......... .......... .......... .......... 22% 25.0M 5s 2024-09-14T21:24:54.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38350K .......... .......... .......... .......... .......... 22% 22.5M 5s 2024-09-14T21:24:54.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38400K .......... .......... .......... .......... .......... 22% 31.5M 5s 2024-09-14T21:24:54.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38450K .......... .......... .......... .......... .......... 22% 28.8M 5s 2024-09-14T21:24:54.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38500K .......... .......... .......... .......... .......... 22% 24.0M 5s 2024-09-14T21:24:54.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38550K .......... .......... .......... .......... .......... 22% 49.5M 5s 2024-09-14T21:24:54.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38600K .......... .......... .......... .......... .......... 22% 32.0M 5s 2024-09-14T21:24:54.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38650K .......... .......... .......... .......... .......... 22% 26.8M 5s 2024-09-14T21:24:54.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38700K .......... .......... .......... .......... .......... 22% 20.5M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38750K .......... .......... .......... .......... .......... 23% 586K 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38800K .......... .......... .......... .......... .......... 23% 163M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38850K .......... .......... .......... .......... .......... 23% 180M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38900K .......... .......... .......... .......... .......... 23% 187M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 38950K .......... .......... .......... .......... .......... 23% 164M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39000K .......... .......... .......... .......... .......... 23% 198M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39050K .......... .......... .......... .......... .......... 23% 183M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39100K .......... .......... .......... .......... .......... 23% 181M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39150K .......... .......... .......... .......... .......... 23% 157M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39200K .......... .......... .......... .......... .......... 23% 199M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39250K .......... .......... .......... .......... .......... 23% 187M 5s 2024-09-14T21:24:54.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39300K .......... .......... .......... .......... .......... 23% 194M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39350K .......... .......... .......... .......... .......... 23% 176M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39400K .......... .......... .......... .......... .......... 23% 191M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39450K .......... .......... .......... .......... .......... 23% 189M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39500K .......... .......... .......... .......... .......... 23% 189M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39550K .......... .......... .......... .......... .......... 23% 165M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39600K .......... .......... .......... .......... .......... 23% 94.9M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39650K .......... .......... .......... .......... .......... 23% 193M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39700K .......... .......... .......... .......... .......... 23% 180M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39750K .......... .......... .......... .......... .......... 23% 164M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39800K .......... .......... .......... .......... .......... 23% 199M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39850K .......... .......... .......... .......... .......... 23% 198M 5s 2024-09-14T21:24:54.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39900K .......... .......... .......... .......... .......... 23% 190M 5s 2024-09-14T21:24:54.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 39950K .......... .......... .......... .......... .......... 23% 158M 5s 2024-09-14T21:24:54.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40000K .......... .......... .......... .......... .......... 23% 193M 5s 2024-09-14T21:24:54.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40050K .......... .......... .......... .......... .......... 23% 199M 5s 2024-09-14T21:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40100K .......... .......... .......... .......... .......... 23% 2.65M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40150K .......... .......... .......... .......... .......... 23% 169M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40200K .......... .......... .......... .......... .......... 23% 189M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40250K .......... .......... .......... .......... .......... 23% 151M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40300K .......... .......... .......... .......... .......... 23% 190M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40350K .......... .......... .......... .......... .......... 23% 146M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40400K .......... .......... .......... .......... .......... 23% 193M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40450K .......... .......... .......... .......... .......... 24% 185M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40500K .......... .......... .......... .......... .......... 24% 195M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40550K .......... .......... .......... .......... .......... 24% 152M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40600K .......... .......... .......... .......... .......... 24% 198M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40650K .......... .......... .......... .......... .......... 24% 184M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40700K .......... .......... .......... .......... .......... 24% 168M 5s 2024-09-14T21:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40750K .......... .......... .......... .......... .......... 24% 156M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40800K .......... .......... .......... .......... .......... 24% 184M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40850K .......... .......... .......... .......... .......... 24% 175M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40900K .......... .......... .......... .......... .......... 24% 195M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 40950K .......... .......... .......... .......... .......... 24% 158M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41000K .......... .......... .......... .......... .......... 24% 184M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41050K .......... .......... .......... .......... .......... 24% 196M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41100K .......... .......... .......... .......... .......... 24% 200M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41150K .......... .......... .......... .......... .......... 24% 140M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41200K .......... .......... .......... .......... .......... 24% 181M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41250K .......... .......... .......... .......... .......... 24% 185M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41300K .......... .......... .......... .......... .......... 24% 189M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41350K .......... .......... .......... .......... .......... 24% 81.1M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41400K .......... .......... .......... .......... .......... 24% 195M 5s 2024-09-14T21:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41450K .......... .......... .......... .......... .......... 24% 172M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41500K .......... .......... .......... .......... .......... 24% 183M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41550K .......... .......... .......... .......... .......... 24% 149M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41600K .......... .......... .......... .......... .......... 24% 195M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41650K .......... .......... .......... .......... .......... 24% 176M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41700K .......... .......... .......... .......... .......... 24% 181M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41750K .......... .......... .......... .......... .......... 24% 175M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41800K .......... .......... .......... .......... .......... 24% 201M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41850K .......... .......... .......... .......... .......... 24% 161M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41900K .......... .......... .......... .......... .......... 24% 196M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 41950K .......... .......... .......... .......... .......... 24% 157M 5s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42000K .......... .......... .......... .......... .......... 24% 193M 4s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42050K .......... .......... .......... .......... .......... 24% 174M 4s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42100K .......... .......... .......... .......... .......... 25% 200M 4s 2024-09-14T21:24:54.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42150K .......... .......... .......... .......... .......... 25% 161M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42200K .......... .......... .......... .......... .......... 25% 189M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42250K .......... .......... .......... .......... .......... 25% 198M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42300K .......... .......... .......... .......... .......... 25% 204M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42350K .......... .......... .......... .......... .......... 25% 142M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42400K .......... .......... .......... .......... .......... 25% 188M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42450K .......... .......... .......... .......... .......... 25% 36.7M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42500K .......... .......... .......... .......... .......... 25% 19.0M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42550K .......... .......... .......... .......... .......... 25% 65.4M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42600K .......... .......... .......... .......... .......... 25% 27.7M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42650K .......... .......... .......... .......... .......... 25% 31.6M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42700K .......... .......... .......... .......... .......... 25% 24.3M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42750K .......... .......... .......... .......... .......... 25% 23.0M 4s 2024-09-14T21:24:54.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42800K .......... .......... .......... .......... .......... 25% 25.5M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42850K .......... .......... .......... .......... .......... 25% 31.9M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42900K .......... .......... .......... .......... .......... 25% 24.2M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 42950K .......... .......... .......... .......... .......... 25% 53.5M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43000K .......... .......... .......... .......... .......... 25% 35.0M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43050K .......... .......... .......... .......... .......... 25% 33.9M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43100K .......... .......... .......... .......... .......... 25% 23.4M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43150K .......... .......... .......... .......... .......... 25% 21.7M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43200K .......... .......... .......... .......... .......... 25% 42.0M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43250K .......... .......... .......... .......... .......... 25% 37.3M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43300K .......... .......... .......... .......... .......... 25% 22.7M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43350K .......... .......... .......... .......... .......... 25% 22.9M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43400K .......... .......... .......... .......... .......... 25% 62.3M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43450K .......... .......... .......... .......... .......... 25% 22.1M 4s 2024-09-14T21:24:54.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43500K .......... .......... .......... .......... .......... 25% 31.1M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43550K .......... .......... .......... .......... .......... 25% 22.0M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43600K .......... .......... .......... .......... .......... 25% 32.6M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43650K .......... .......... .......... .......... .......... 25% 26.3M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43700K .......... .......... .......... .......... .......... 25% 45.3M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43750K .......... .......... .......... .......... .......... 25% 24.6M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43800K .......... .......... .......... .......... .......... 26% 36.8M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43850K .......... .......... .......... .......... .......... 26% 23.6M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43900K .......... .......... .......... .......... .......... 26% 52.9M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 43950K .......... .......... .......... .......... .......... 26% 24.9M 4s 2024-09-14T21:24:54.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44000K .......... .......... .......... .......... .......... 26% 24.4M 4s 2024-09-14T21:24:54.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44050K .......... .......... .......... .......... .......... 26% 23.4M 4s 2024-09-14T21:24:54.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44100K .......... .......... .......... .......... .......... 26% 25.5M 4s 2024-09-14T21:24:54.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44150K .......... .......... .......... .......... .......... 26% 27.1M 4s 2024-09-14T21:24:54.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44200K .......... .......... .......... .......... .......... 26% 101M 4s 2024-09-14T21:24:54.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44250K .......... .......... .......... .......... .......... 26% 27.5M 4s 2024-09-14T21:24:54.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44300K .......... .......... .......... .......... .......... 26% 23.4M 4s 2024-09-14T21:24:54.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44350K .......... .......... .......... .......... .......... 26% 23.9M 4s 2024-09-14T21:24:54.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44400K .......... .......... .......... .......... .......... 26% 29.0M 4s 2024-09-14T21:24:54.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44450K .......... .......... .......... .......... .......... 26% 46.3M 4s 2024-09-14T21:24:54.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44500K .......... .......... .......... .......... .......... 26% 22.5M 4s 2024-09-14T21:24:54.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44550K .......... .......... .......... .......... .......... 26% 46.7M 4s 2024-09-14T21:24:54.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44600K .......... .......... .......... .......... .......... 26% 23.2M 4s 2024-09-14T21:24:54.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44650K .......... .......... .......... .......... .......... 26% 27.2M 4s 2024-09-14T21:24:54.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44700K .......... .......... .......... .......... .......... 26% 48.6M 4s 2024-09-14T21:24:54.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44750K .......... .......... .......... .......... .......... 26% 20.9M 4s 2024-09-14T21:24:54.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44800K .......... .......... .......... .......... .......... 26% 26.9M 4s 2024-09-14T21:24:54.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44850K .......... .......... .......... .......... .......... 26% 38.5M 4s 2024-09-14T21:24:54.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44900K .......... .......... .......... .......... .......... 26% 24.5M 4s 2024-09-14T21:24:54.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 44950K .......... .......... .......... .......... .......... 26% 43.1M 4s 2024-09-14T21:24:54.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45000K .......... .......... .......... .......... .......... 26% 23.4M 4s 2024-09-14T21:24:54.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45050K .......... .......... .......... .......... .......... 26% 43.9M 4s 2024-09-14T21:24:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45100K .......... .......... .......... .......... .......... 26% 24.0M 4s 2024-09-14T21:24:54.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45150K .......... .......... .......... .......... .......... 26% 25.8M 4s 2024-09-14T21:24:54.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45200K .......... .......... .......... .......... .......... 26% 22.0M 4s 2024-09-14T21:24:54.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45250K .......... .......... .......... .......... .......... 26% 47.0M 4s 2024-09-14T21:24:54.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45300K .......... .......... .......... .......... .......... 26% 23.1M 4s 2024-09-14T21:24:54.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45350K .......... .......... .......... .......... .......... 26% 37.9M 4s 2024-09-14T21:24:54.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45400K .......... .......... .......... .......... .......... 26% 22.1M 4s 2024-09-14T21:24:54.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45450K .......... .......... .......... .......... .......... 26% 56.2M 4s 2024-09-14T21:24:54.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45500K .......... .......... .......... .......... .......... 27% 24.6M 4s 2024-09-14T21:24:54.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45550K .......... .......... .......... .......... .......... 27% 22.6M 4s 2024-09-14T21:24:54.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45600K .......... .......... .......... .......... .......... 27% 43.5M 4s 2024-09-14T21:24:54.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45650K .......... .......... .......... .......... .......... 27% 22.3M 4s 2024-09-14T21:24:54.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45700K .......... .......... .......... .......... .......... 27% 21.3M 4s 2024-09-14T21:24:54.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45750K .......... .......... .......... .......... .......... 27% 45.9M 4s 2024-09-14T21:24:54.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45800K .......... .......... .......... .......... .......... 27% 27.1M 4s 2024-09-14T21:24:54.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45850K .......... .......... .......... .......... .......... 27% 36.7M 4s 2024-09-14T21:24:54.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45900K .......... .......... .......... .......... .......... 27% 23.7M 4s 2024-09-14T21:24:54.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 45950K .......... .......... .......... .......... .......... 27% 23.7M 4s 2024-09-14T21:24:54.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46000K .......... .......... .......... .......... .......... 27% 46.6M 4s 2024-09-14T21:24:54.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46050K .......... .......... .......... .......... .......... 27% 24.7M 4s 2024-09-14T21:24:54.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46100K .......... .......... .......... .......... .......... 27% 29.4M 4s 2024-09-14T21:24:54.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46150K .......... .......... .......... .......... .......... 27% 30.5M 4s 2024-09-14T21:24:54.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46200K .......... .......... .......... .......... .......... 27% 48.6M 4s 2024-09-14T21:24:54.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46250K .......... .......... .......... .......... .......... 27% 25.0M 4s 2024-09-14T21:24:54.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46300K .......... .......... .......... .......... .......... 27% 34.7M 4s 2024-09-14T21:24:54.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46350K .......... .......... .......... .......... .......... 27% 20.5M 4s 2024-09-14T21:24:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46400K .......... .......... .......... .......... .......... 27% 20.7M 4s 2024-09-14T21:24:54.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46450K .......... .......... .......... .......... .......... 27% 46.7M 4s 2024-09-14T21:24:54.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46500K .......... .......... .......... .......... .......... 27% 39.0M 4s 2024-09-14T21:24:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46550K .......... .......... .......... .......... .......... 27% 25.0M 4s 2024-09-14T21:24:54.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46600K .......... .......... .......... .......... .......... 27% 27.7M 4s 2024-09-14T21:24:54.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46650K .......... .......... .......... .......... .......... 27% 28.3M 4s 2024-09-14T21:24:54.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46700K .......... .......... .......... .......... .......... 27% 47.6M 4s 2024-09-14T21:24:54.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46750K .......... .......... .......... .......... .......... 27% 23.6M 4s 2024-09-14T21:24:54.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46800K .......... .......... .......... .......... .......... 27% 22.7M 4s 2024-09-14T21:24:54.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46850K .......... .......... .......... .......... .......... 27% 41.5M 4s 2024-09-14T21:24:54.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46900K .......... .......... .......... .......... .......... 27% 23.9M 4s 2024-09-14T21:24:54.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 46950K .......... .......... .......... .......... .......... 27% 22.3M 4s 2024-09-14T21:24:54.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47000K .......... .......... .......... .......... .......... 27% 53.7M 4s 2024-09-14T21:24:54.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47050K .......... .......... .......... .......... .......... 27% 25.7M 4s 2024-09-14T21:24:54.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47100K .......... .......... .......... .......... .......... 27% 34.9M 4s 2024-09-14T21:24:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47150K .......... .......... .......... .......... .......... 28% 22.5M 4s 2024-09-14T21:24:54.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47200K .......... .......... .......... .......... .......... 28% 27.5M 4s 2024-09-14T21:24:54.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47250K .......... .......... .......... .......... .......... 28% 45.3M 4s 2024-09-14T21:24:54.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47300K .......... .......... .......... .......... .......... 28% 24.8M 4s 2024-09-14T21:24:54.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47350K .......... .......... .......... .......... .......... 28% 38.3M 4s 2024-09-14T21:24:54.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47400K .......... .......... .......... .......... .......... 28% 20.9M 4s 2024-09-14T21:24:54.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47450K .......... .......... .......... .......... .......... 28% 24.9M 4s 2024-09-14T21:24:54.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47500K .......... .......... .......... .......... .......... 28% 75.7M 4s 2024-09-14T21:24:54.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47550K .......... .......... .......... .......... .......... 28% 22.2M 4s 2024-09-14T21:24:54.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47600K .......... .......... .......... .......... .......... 28% 24.0M 4s 2024-09-14T21:24:54.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47650K .......... .......... .......... .......... .......... 28% 39.0M 4s 2024-09-14T21:24:54.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47700K .......... .......... .......... .......... .......... 28% 43.9M 4s 2024-09-14T21:24:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47750K .......... .......... .......... .......... .......... 28% 27.2M 4s 2024-09-14T21:24:54.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47800K .......... .......... .......... .......... .......... 28% 22.0M 4s 2024-09-14T21:24:54.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47850K .......... .......... .......... .......... .......... 28% 33.1M 4s 2024-09-14T21:24:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47900K .......... .......... .......... .......... .......... 28% 26.8M 4s 2024-09-14T21:24:54.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 47950K .......... .......... .......... .......... .......... 28% 24.4M 4s 2024-09-14T21:24:54.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48000K .......... .......... .......... .......... .......... 28% 22.6M 4s 2024-09-14T21:24:54.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48050K .......... .......... .......... .......... .......... 28% 49.5M 4s 2024-09-14T21:24:54.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48100K .......... .......... .......... .......... .......... 28% 26.0M 4s 2024-09-14T21:24:54.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48150K .......... .......... .......... .......... .......... 28% 36.9M 4s 2024-09-14T21:24:54.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48200K .......... .......... .......... .......... .......... 28% 24.8M 4s 2024-09-14T21:24:54.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48250K .......... .......... .......... .......... .......... 28% 46.5M 4s 2024-09-14T21:24:54.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48300K .......... .......... .......... .......... .......... 28% 22.9M 4s 2024-09-14T21:24:54.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48350K .......... .......... .......... .......... .......... 28% 26.1M 4s 2024-09-14T21:24:54.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48400K .......... .......... .......... .......... .......... 28% 31.6M 4s 2024-09-14T21:24:54.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48450K .......... .......... .......... .......... .......... 28% 25.8M 4s 2024-09-14T21:24:54.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48500K .......... .......... .......... .......... .......... 28% 57.4M 4s 2024-09-14T21:24:55.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48550K .......... .......... .......... .......... .......... 28% 23.4M 4s 2024-09-14T21:24:55.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48600K .......... .......... .......... .......... .......... 28% 37.3M 4s 2024-09-14T21:24:55.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48650K .......... .......... .......... .......... .......... 28% 23.8M 4s 2024-09-14T21:24:55.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48700K .......... .......... .......... .......... .......... 28% 22.7M 4s 2024-09-14T21:24:55.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48750K .......... .......... .......... .......... .......... 28% 25.1M 4s 2024-09-14T21:24:55.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48800K .......... .......... .......... .......... .......... 28% 53.4M 4s 2024-09-14T21:24:55.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48850K .......... .......... .......... .......... .......... 29% 25.6M 4s 2024-09-14T21:24:55.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48900K .......... .......... .......... .......... .......... 29% 27.7M 4s 2024-09-14T21:24:55.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 48950K .......... .......... .......... .......... .......... 29% 60.5M 4s 2024-09-14T21:24:55.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49000K .......... .......... .......... .......... .......... 29% 29.3M 4s 2024-09-14T21:24:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49050K .......... .......... .......... .......... .......... 29% 22.4M 4s 2024-09-14T21:24:55.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49100K .......... .......... .......... .......... .......... 29% 37.8M 4s 2024-09-14T21:24:55.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49150K .......... .......... .......... .......... .......... 29% 19.6M 4s 2024-09-14T21:24:55.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49200K .......... .......... .......... .......... .......... 29% 22.6M 4s 2024-09-14T21:24:55.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49250K .......... .......... .......... .......... .......... 29% 26.8M 4s 2024-09-14T21:24:55.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49300K .......... .......... .......... .......... .......... 29% 66.8M 4s 2024-09-14T21:24:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49350K .......... .......... .......... .......... .......... 29% 23.8M 4s 2024-09-14T21:24:55.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49400K .......... .......... .......... .......... .......... 29% 23.6M 4s 2024-09-14T21:24:55.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49450K .......... .......... .......... .......... .......... 29% 38.7M 4s 2024-09-14T21:24:55.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49500K .......... .......... .......... .......... .......... 29% 52.4M 4s 2024-09-14T21:24:55.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49550K .......... .......... .......... .......... .......... 29% 25.7M 4s 2024-09-14T21:24:55.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49600K .......... .......... .......... .......... .......... 29% 22.1M 4s 2024-09-14T21:24:55.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49650K .......... .......... .......... .......... .......... 29% 39.3M 4s 2024-09-14T21:24:55.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49700K .......... .......... .......... .......... .......... 29% 20.6M 4s 2024-09-14T21:24:55.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49750K .......... .......... .......... .......... .......... 29% 37.6M 4s 2024-09-14T21:24:55.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49800K .......... .......... .......... .......... .......... 29% 37.7M 4s 2024-09-14T21:24:55.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49850K .......... .......... .......... .......... .......... 29% 24.3M 4s 2024-09-14T21:24:55.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49900K .......... .......... .......... .......... .......... 29% 33.1M 4s 2024-09-14T21:24:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 49950K .......... .......... .......... .......... .......... 29% 18.3M 4s 2024-09-14T21:24:55.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50000K .......... .......... .......... .......... .......... 29% 36.8M 4s 2024-09-14T21:24:55.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50050K .......... .......... .......... .......... .......... 29% 50.8M 4s 2024-09-14T21:24:55.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50100K .......... .......... .......... .......... .......... 29% 20.5M 4s 2024-09-14T21:24:55.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50150K .......... .......... .......... .......... .......... 29% 41.9M 4s 2024-09-14T21:24:55.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50200K .......... .......... .......... .......... .......... 29% 26.4M 4s 2024-09-14T21:24:55.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50250K .......... .......... .......... .......... .......... 29% 34.3M 4s 2024-09-14T21:24:55.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50300K .......... .......... .......... .......... .......... 29% 29.1M 4s 2024-09-14T21:24:55.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50350K .......... .......... .......... .......... .......... 29% 29.1M 4s 2024-09-14T21:24:55.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50400K .......... .......... .......... .......... .......... 29% 21.0M 4s 2024-09-14T21:24:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50450K .......... .......... .......... .......... .......... 29% 34.8M 4s 2024-09-14T21:24:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50500K .......... .......... .......... .......... .......... 29% 27.1M 4s 2024-09-14T21:24:55.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50550K .......... .......... .......... .......... .......... 30% 32.8M 4s 2024-09-14T21:24:55.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50600K .......... .......... .......... .......... .......... 30% 27.1M 4s 2024-09-14T21:24:55.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50650K .......... .......... .......... .......... .......... 30% 37.9M 4s 2024-09-14T21:24:55.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50700K .......... .......... .......... .......... .......... 30% 21.2M 4s 2024-09-14T21:24:55.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50750K .......... .......... .......... .......... .......... 30% 24.7M 4s 2024-09-14T21:24:55.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50800K .......... .......... .......... .......... .......... 30% 23.5M 4s 2024-09-14T21:24:55.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50850K .......... .......... .......... .......... .......... 30% 62.2M 4s 2024-09-14T21:24:55.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50900K .......... .......... .......... .......... .......... 30% 23.1M 4s 2024-09-14T21:24:55.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 50950K .......... .......... .......... .......... .......... 30% 27.0M 4s 2024-09-14T21:24:55.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51000K .......... .......... .......... .......... .......... 30% 36.1M 4s 2024-09-14T21:24:55.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51050K .......... .......... .......... .......... .......... 30% 47.3M 4s 2024-09-14T21:24:55.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51100K .......... .......... .......... .......... .......... 30% 22.8M 4s 2024-09-14T21:24:55.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51150K .......... .......... .......... .......... .......... 30% 24.9M 4s 2024-09-14T21:24:55.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51200K .......... .......... .......... .......... .......... 30% 37.7M 4s 2024-09-14T21:24:55.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51250K .......... .......... .......... .......... .......... 30% 23.0M 4s 2024-09-14T21:24:55.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51300K .......... .......... .......... .......... .......... 30% 60.7M 4s 2024-09-14T21:24:55.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51350K .......... .......... .......... .......... .......... 30% 23.3M 4s 2024-09-14T21:24:55.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51400K .......... .......... .......... .......... .......... 30% 34.1M 4s 2024-09-14T21:24:55.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51450K .......... .......... .......... .......... .......... 30% 23.8M 4s 2024-09-14T21:24:55.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51500K .......... .......... .......... .......... .......... 30% 23.5M 4s 2024-09-14T21:24:55.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51550K .......... .......... .......... .......... .......... 30% 29.5M 4s 2024-09-14T21:24:55.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51600K .......... .......... .......... .......... .......... 30% 40.8M 4s 2024-09-14T21:24:55.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51650K .......... .......... .......... .......... .......... 30% 22.6M 4s 2024-09-14T21:24:55.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51700K .......... .......... .......... .......... .......... 30% 25.2M 4s 2024-09-14T21:24:55.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51750K .......... .......... .......... .......... .......... 30% 38.7M 4s 2024-09-14T21:24:55.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51800K .......... .......... .......... .......... .......... 30% 47.5M 4s 2024-09-14T21:24:55.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51850K .......... .......... .......... .......... .......... 30% 25.2M 4s 2024-09-14T21:24:55.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51900K .......... .......... .......... .......... .......... 30% 35.0M 4s 2024-09-14T21:24:55.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 51950K .......... .......... .......... .......... .......... 30% 21.7M 4s 2024-09-14T21:24:55.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52000K .......... .......... .......... .......... .......... 30% 25.2M 4s 2024-09-14T21:24:55.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52050K .......... .......... .......... .......... .......... 30% 23.6M 4s 2024-09-14T21:24:55.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52100K .......... .......... .......... .......... .......... 30% 47.7M 4s 2024-09-14T21:24:55.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52150K .......... .......... .......... .......... .......... 30% 20.0M 4s 2024-09-14T21:24:55.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52200K .......... .......... .......... .......... .......... 30% 55.1M 4s 2024-09-14T21:24:55.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52250K .......... .......... .......... .......... .......... 31% 24.1M 4s 2024-09-14T21:24:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52300K .......... .......... .......... .......... .......... 31% 41.4M 4s 2024-09-14T21:24:55.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52350K .......... .......... .......... .......... .......... 31% 25.5M 4s 2024-09-14T21:24:55.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52400K .......... .......... .......... .......... .......... 31% 24.8M 4s 2024-09-14T21:24:55.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52450K .......... .......... .......... .......... .......... 31% 22.7M 4s 2024-09-14T21:24:55.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52500K .......... .......... .......... .......... .......... 31% 41.1M 4s 2024-09-14T21:24:55.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52550K .......... .......... .......... .......... .......... 31% 21.9M 4s 2024-09-14T21:24:55.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52600K .......... .......... .......... .......... .......... 31% 67.8M 4s 2024-09-14T21:24:55.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52650K .......... .......... .......... .......... .......... 31% 22.7M 4s 2024-09-14T21:24:55.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52700K .......... .......... .......... .......... .......... 31% 33.2M 4s 2024-09-14T21:24:55.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52750K .......... .......... .......... .......... .......... 31% 21.1M 4s 2024-09-14T21:24:55.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52800K .......... .......... .......... .......... .......... 31% 28.3M 4s 2024-09-14T21:24:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52850K .......... .......... .......... .......... .......... 31% 54.2M 4s 2024-09-14T21:24:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52900K .......... .......... .......... .......... .......... 31% 25.1M 4s 2024-09-14T21:24:55.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 52950K .......... .......... .......... .......... .......... 31% 39.3M 4s 2024-09-14T21:24:55.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53000K .......... .......... .......... .......... .......... 31% 21.6M 4s 2024-09-14T21:24:55.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53050K .......... .......... .......... .......... .......... 31% 23.5M 4s 2024-09-14T21:24:55.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53100K .......... .......... .......... .......... .......... 31% 73.9M 4s 2024-09-14T21:24:55.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53150K .......... .......... .......... .......... .......... 31% 23.0M 4s 2024-09-14T21:24:55.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53200K .......... .......... .......... .......... .......... 31% 24.1M 4s 2024-09-14T21:24:55.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53250K .......... .......... .......... .......... .......... 31% 36.4M 4s 2024-09-14T21:24:55.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53300K .......... .......... .......... .......... .......... 31% 24.4M 4s 2024-09-14T21:24:55.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53350K .......... .......... .......... .......... .......... 31% 51.9M 4s 2024-09-14T21:24:55.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53400K .......... .......... .......... .......... .......... 31% 21.8M 4s 2024-09-14T21:24:55.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53450K .......... .......... .......... .......... .......... 31% 45.6M 4s 2024-09-14T21:24:55.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53500K .......... .......... .......... .......... .......... 31% 24.7M 4s 2024-09-14T21:24:55.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53550K .......... .......... .......... .......... .......... 31% 23.4M 4s 2024-09-14T21:24:55.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53600K .......... .......... .......... .......... .......... 31% 40.0M 4s 2024-09-14T21:24:55.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53650K .......... .......... .......... .......... .......... 31% 22.0M 4s 2024-09-14T21:24:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53700K .......... .......... .......... .......... .......... 31% 39.7M 4s 2024-09-14T21:24:55.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53750K .......... .......... .......... .......... .......... 31% 28.8M 4s 2024-09-14T21:24:55.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53800K .......... .......... .......... .......... .......... 31% 24.2M 4s 2024-09-14T21:24:55.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53850K .......... .......... .......... .......... .......... 31% 44.0M 4s 2024-09-14T21:24:55.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53900K .......... .......... .......... .......... .......... 32% 24.9M 4s 2024-09-14T21:24:55.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 53950K .......... .......... .......... .......... .......... 32% 24.1M 4s 2024-09-14T21:24:55.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54000K .......... .......... .......... .......... .......... 32% 38.1M 4s 2024-09-14T21:24:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54050K .......... .......... .......... .......... .......... 32% 28.1M 4s 2024-09-14T21:24:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54100K .......... .......... .......... .......... .......... 32% 34.2M 4s 2024-09-14T21:24:55.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54150K .......... .......... .......... .......... .......... 32% 24.2M 4s 2024-09-14T21:24:55.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54200K .......... .......... .......... .......... .......... 32% 41.6M 4s 2024-09-14T21:24:55.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54250K .......... .......... .......... .......... .......... 32% 23.9M 4s 2024-09-14T21:24:55.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54300K .......... .......... .......... .......... .......... 32% 24.4M 4s 2024-09-14T21:24:55.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54350K .......... .......... .......... .......... .......... 32% 25.0M 4s 2024-09-14T21:24:55.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54400K .......... .......... .......... .......... .......... 32% 40.4M 4s 2024-09-14T21:24:55.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54450K .......... .......... .......... .......... .......... 32% 26.2M 4s 2024-09-14T21:24:55.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54500K .......... .......... .......... .......... .......... 32% 40.1M 4s 2024-09-14T21:24:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54550K .......... .......... .......... .......... .......... 32% 20.6M 4s 2024-09-14T21:24:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54600K .......... .......... .......... .......... .......... 32% 82.5M 4s 2024-09-14T21:24:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54650K .......... .......... .......... .......... .......... 32% 21.2M 4s 2024-09-14T21:24:55.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54700K .......... .......... .......... .......... .......... 32% 43.1M 4s 2024-09-14T21:24:55.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54750K .......... .......... .......... .......... .......... 32% 23.4M 4s 2024-09-14T21:24:55.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54800K .......... .......... .......... .......... .......... 32% 22.5M 4s 2024-09-14T21:24:55.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54850K .......... .......... .......... .......... .......... 32% 25.4M 4s 2024-09-14T21:24:55.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54900K .......... .......... .......... .......... .......... 32% 57.8M 4s 2024-09-14T21:24:55.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 54950K .......... .......... .......... .......... .......... 32% 21.5M 4s 2024-09-14T21:24:55.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55000K .......... .......... .......... .......... .......... 32% 38.9M 4s 2024-09-14T21:24:55.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55050K .......... .......... .......... .......... .......... 32% 25.5M 4s 2024-09-14T21:24:55.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55100K .......... .......... .......... .......... .......... 32% 50.1M 4s 2024-09-14T21:24:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55150K .......... .......... .......... .......... .......... 32% 23.7M 4s 2024-09-14T21:24:55.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55200K .......... .......... .......... .......... .......... 32% 24.4M 4s 2024-09-14T21:24:55.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55250K .......... .......... .......... .......... .......... 32% 30.5M 4s 2024-09-14T21:24:55.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55300K .......... .......... .......... .......... .......... 32% 26.2M 4s 2024-09-14T21:24:55.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55350K .......... .......... .......... .......... .......... 32% 24.3M 4s 2024-09-14T21:24:55.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55400K .......... .......... .......... .......... .......... 32% 55.7M 4s 2024-09-14T21:24:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55450K .......... .......... .......... .......... .......... 32% 32.7M 4s 2024-09-14T21:24:55.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55500K .......... .......... .......... .......... .......... 32% 24.6M 4s 2024-09-14T21:24:55.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55550K .......... .......... .......... .......... .......... 32% 19.2M 4s 2024-09-14T21:24:55.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55600K .......... .......... .......... .......... .......... 33% 29.9M 4s 2024-09-14T21:24:55.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55650K .......... .......... .......... .......... .......... 33% 53.0M 4s 2024-09-14T21:24:55.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55700K .......... .......... .......... .......... .......... 33% 24.6M 4s 2024-09-14T21:24:55.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55750K .......... .......... .......... .......... .......... 33% 35.1M 4s 2024-09-14T21:24:55.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55800K .......... .......... .......... .......... .......... 33% 25.3M 4s 2024-09-14T21:24:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55850K .......... .......... .......... .......... .......... 33% 39.7M 4s 2024-09-14T21:24:55.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55900K .......... .......... .......... .......... .......... 33% 28.9M 4s 2024-09-14T21:24:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 55950K .......... .......... .......... .......... .......... 33% 23.8M 4s 2024-09-14T21:24:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56000K .......... .......... .......... .......... .......... 33% 34.9M 4s 2024-09-14T21:24:55.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56050K .......... .......... .......... .......... .......... 33% 22.5M 4s 2024-09-14T21:24:55.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56100K .......... .......... .......... .......... .......... 33% 24.7M 4s 2024-09-14T21:24:55.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56150K .......... .......... .......... .......... .......... 33% 53.5M 4s 2024-09-14T21:24:55.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56200K .......... .......... .......... .......... .......... 33% 23.8M 4s 2024-09-14T21:24:55.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56250K .......... .......... .......... .......... .......... 33% 37.4M 4s 2024-09-14T21:24:55.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56300K .......... .......... .......... .......... .......... 33% 24.6M 4s 2024-09-14T21:24:55.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56350K .......... .......... .......... .......... .......... 33% 35.3M 4s 2024-09-14T21:24:55.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56400K .......... .......... .......... .......... .......... 33% 29.8M 4s 2024-09-14T21:24:55.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56450K .......... .......... .......... .......... .......... 33% 22.3M 4s 2024-09-14T21:24:55.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56500K .......... .......... .......... .......... .......... 33% 38.2M 4s 2024-09-14T21:24:55.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56550K .......... .......... .......... .......... .......... 33% 22.5M 4s 2024-09-14T21:24:55.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56600K .......... .......... .......... .......... .......... 33% 24.8M 4s 2024-09-14T21:24:55.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56650K .......... .......... .......... .......... .......... 33% 48.3M 4s 2024-09-14T21:24:55.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56700K .......... .......... .......... .......... .......... 33% 36.0M 4s 2024-09-14T21:24:55.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56750K .......... .......... .......... .......... .......... 33% 18.6M 4s 2024-09-14T21:24:55.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56800K .......... .......... .......... .......... .......... 33% 55.4M 4s 2024-09-14T21:24:55.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56850K .......... .......... .......... .......... .......... 33% 18.9M 4s 2024-09-14T21:24:55.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56900K .......... .......... .......... .......... .......... 33% 60.8M 4s 2024-09-14T21:24:55.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 56950K .......... .......... .......... .......... .......... 33% 23.8M 4s 2024-09-14T21:24:55.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57000K .......... .......... .......... .......... .......... 33% 35.0M 4s 2024-09-14T21:24:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57050K .......... .......... .......... .......... .......... 33% 24.3M 4s 2024-09-14T21:24:55.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57100K .......... .......... .......... .......... .......... 33% 23.8M 4s 2024-09-14T21:24:55.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57150K .......... .......... .......... .......... .......... 33% 32.7M 4s 2024-09-14T21:24:55.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57200K .......... .......... .......... .......... .......... 33% 33.6M 4s 2024-09-14T21:24:55.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57250K .......... .......... .......... .......... .......... 33% 24.5M 4s 2024-09-14T21:24:55.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57300K .......... .......... .......... .......... .......... 34% 28.0M 4s 2024-09-14T21:24:55.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57350K .......... .......... .......... .......... .......... 34% 49.1M 4s 2024-09-14T21:24:55.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57400K .......... .......... .......... .......... .......... 34% 33.7M 4s 2024-09-14T21:24:55.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57450K .......... .......... .......... .......... .......... 34% 18.6M 4s 2024-09-14T21:24:55.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57500K .......... .......... .......... .......... .......... 34% 33.3M 4s 2024-09-14T21:24:55.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57550K .......... .......... .......... .......... .......... 34% 26.5M 4s 2024-09-14T21:24:55.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57600K .......... .......... .......... .......... .......... 34% 25.1M 4s 2024-09-14T21:24:55.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57650K .......... .......... .......... .......... .......... 34% 28.1M 4s 2024-09-14T21:24:55.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57700K .......... .......... .......... .......... .......... 34% 52.8M 4s 2024-09-14T21:24:55.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57750K .......... .......... .......... .......... .......... 34% 21.6M 4s 2024-09-14T21:24:55.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57800K .......... .......... .......... .......... .......... 34% 39.8M 4s 2024-09-14T21:24:55.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57850K .......... .......... .......... .......... .......... 34% 23.1M 4s 2024-09-14T21:24:55.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57900K .......... .......... .......... .......... .......... 34% 64.8M 4s 2024-09-14T21:24:55.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 57950K .......... .......... .......... .......... .......... 34% 23.3M 4s 2024-09-14T21:24:55.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58000K .......... .......... .......... .......... .......... 34% 24.5M 4s 2024-09-14T21:24:55.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58050K .......... .......... .......... .......... .......... 34% 30.3M 4s 2024-09-14T21:24:55.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58100K .......... .......... .......... .......... .......... 34% 34.9M 4s 2024-09-14T21:24:55.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58150K .......... .......... .......... .......... .......... 34% 19.8M 4s 2024-09-14T21:24:55.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58200K .......... .......... .......... .......... .......... 34% 53.0M 4s 2024-09-14T21:24:55.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58250K .......... .......... .......... .......... .......... 34% 23.3M 4s 2024-09-14T21:24:55.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58300K .......... .......... .......... .......... .......... 34% 29.2M 4s 2024-09-14T21:24:55.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58350K .......... .......... .......... .......... .......... 34% 28.0M 4s 2024-09-14T21:24:55.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58400K .......... .......... .......... .......... .......... 34% 23.8M 4s 2024-09-14T21:24:55.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58450K .......... .......... .......... .......... .......... 34% 53.9M 4s 2024-09-14T21:24:55.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58500K .......... .......... .......... .......... .......... 34% 23.5M 4s 2024-09-14T21:24:55.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58550K .......... .......... .......... .......... .......... 34% 35.7M 4s 2024-09-14T21:24:55.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58600K .......... .......... .......... .......... .......... 34% 9.25M 4s 2024-09-14T21:24:55.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58650K .......... .......... .......... .......... .......... 34% 165M 4s 2024-09-14T21:24:55.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58700K .......... .......... .......... .......... .......... 34% 131M 4s 2024-09-14T21:24:55.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58750K .......... .......... .......... .......... .......... 34% 30.9M 4s 2024-09-14T21:24:55.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58800K .......... .......... .......... .......... .......... 34% 39.8M 4s 2024-09-14T21:24:55.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58850K .......... .......... .......... .......... .......... 34% 29.5M 4s 2024-09-14T21:24:55.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58900K .......... .......... .......... .......... .......... 34% 23.2M 4s 2024-09-14T21:24:55.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 58950K .......... .......... .......... .......... .......... 35% 49.0M 4s 2024-09-14T21:24:55.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59000K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-09-14T21:24:55.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59050K .......... .......... .......... .......... .......... 35% 39.0M 4s 2024-09-14T21:24:55.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59100K .......... .......... .......... .......... .......... 35% 23.1M 4s 2024-09-14T21:24:55.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59150K .......... .......... .......... .......... .......... 35% 25.0M 4s 2024-09-14T21:24:55.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59200K .......... .......... .......... .......... .......... 35% 50.4M 4s 2024-09-14T21:24:55.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59250K .......... .......... .......... .......... .......... 35% 23.4M 4s 2024-09-14T21:24:55.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59300K .......... .......... .......... .......... .......... 35% 24.9M 4s 2024-09-14T21:24:55.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59350K .......... .......... .......... .......... .......... 35% 28.9M 4s 2024-09-14T21:24:55.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59400K .......... .......... .......... .......... .......... 35% 27.3M 4s 2024-09-14T21:24:55.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59450K .......... .......... .......... .......... .......... 35% 47.4M 4s 2024-09-14T21:24:55.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59500K .......... .......... .......... .......... .......... 35% 23.0M 4s 2024-09-14T21:24:55.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59550K .......... .......... .......... .......... .......... 35% 27.2M 4s 2024-09-14T21:24:55.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59600K .......... .......... .......... .......... .......... 35% 37.4M 4s 2024-09-14T21:24:55.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59650K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-09-14T21:24:55.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59700K .......... .......... .......... .......... .......... 35% 43.6M 4s 2024-09-14T21:24:55.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59750K .......... .......... .......... .......... .......... 35% 25.2M 4s 2024-09-14T21:24:55.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59800K .......... .......... .......... .......... .......... 35% 35.7M 4s 2024-09-14T21:24:55.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59850K .......... .......... .......... .......... .......... 35% 22.8M 4s 2024-09-14T21:24:55.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59900K .......... .......... .......... .......... .......... 35% 26.5M 4s 2024-09-14T21:24:55.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 59950K .......... .......... .......... .......... .......... 35% 22.9M 4s 2024-09-14T21:24:55.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60000K .......... .......... .......... .......... .......... 35% 39.2M 4s 2024-09-14T21:24:55.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60050K .......... .......... .......... .......... .......... 35% 27.4M 4s 2024-09-14T21:24:55.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60100K .......... .......... .......... .......... .......... 35% 42.9M 4s 2024-09-14T21:24:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60150K .......... .......... .......... .......... .......... 35% 22.2M 4s 2024-09-14T21:24:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60200K .......... .......... .......... .......... .......... 35% 58.0M 4s 2024-09-14T21:24:55.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60250K .......... .......... .......... .......... .......... 35% 23.2M 4s 2024-09-14T21:24:55.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60300K .......... .......... .......... .......... .......... 35% 32.1M 4s 2024-09-14T21:24:55.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60350K .......... .......... .......... .......... .......... 35% 24.6M 4s 2024-09-14T21:24:55.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60400K .......... .......... .......... .......... .......... 35% 26.4M 4s 2024-09-14T21:24:55.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60450K .......... .......... .......... .......... .......... 35% 23.8M 4s 2024-09-14T21:24:55.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60500K .......... .......... .......... .......... .......... 35% 61.4M 4s 2024-09-14T21:24:55.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60550K .......... .......... .......... .......... .......... 35% 32.2M 4s 2024-09-14T21:24:55.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60600K .......... .......... .......... .......... .......... 35% 20.6M 4s 2024-09-14T21:24:55.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60650K .......... .......... .......... .......... .......... 36% 29.8M 4s 2024-09-14T21:24:55.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60700K .......... .......... .......... .......... .......... 36% 47.8M 4s 2024-09-14T21:24:55.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60750K .......... .......... .......... .......... .......... 36% 22.9M 4s 2024-09-14T21:24:55.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60800K .......... .......... .......... .......... .......... 36% 26.6M 4s 2024-09-14T21:24:55.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60850K .......... .......... .......... .......... .......... 36% 37.3M 4s 2024-09-14T21:24:55.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60900K .......... .......... .......... .......... .......... 36% 24.2M 4s 2024-09-14T21:24:55.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 60950K .......... .......... .......... .......... .......... 36% 46.0M 4s 2024-09-14T21:24:55.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61000K .......... .......... .......... .......... .......... 36% 30.5M 4s 2024-09-14T21:24:55.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61050K .......... .......... .......... .......... .......... 36% 25.9M 4s 2024-09-14T21:24:55.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61100K .......... .......... .......... .......... .......... 36% 25.6M 4s 2024-09-14T21:24:55.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61150K .......... .......... .......... .......... .......... 36% 22.9M 4s 2024-09-14T21:24:55.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61200K .......... .......... .......... .......... .......... 36% 26.8M 4s 2024-09-14T21:24:55.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61250K .......... .......... .......... .......... .......... 36% 44.9M 4s 2024-09-14T21:24:55.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61300K .......... .......... .......... .......... .......... 36% 24.5M 4s 2024-09-14T21:24:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61350K .......... .......... .......... .......... .......... 36% 35.9M 4s 2024-09-14T21:24:55.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61400K .......... .......... .......... .......... .......... 36% 24.3M 4s 2024-09-14T21:24:55.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61450K .......... .......... .......... .......... .......... 36% 52.0M 4s 2024-09-14T21:24:55.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61500K .......... .......... .......... .......... .......... 36% 24.9M 4s 2024-09-14T21:24:55.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61550K .......... .......... .......... .......... .......... 36% 23.2M 4s 2024-09-14T21:24:55.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61600K .......... .......... .......... .......... .......... 36% 36.3M 4s 2024-09-14T21:24:55.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61650K .......... .......... .......... .......... .......... 36% 25.1M 4s 2024-09-14T21:24:55.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61700K .......... .......... .......... .......... .......... 36% 24.0M 4s 2024-09-14T21:24:55.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61750K .......... .......... .......... .......... .......... 36% 43.5M 4s 2024-09-14T21:24:55.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61800K .......... .......... .......... .......... .......... 36% 22.7M 4s 2024-09-14T21:24:55.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61850K .......... .......... .......... .......... .......... 36% 35.3M 4s 2024-09-14T21:24:55.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61900K .......... .......... .......... .......... .......... 36% 29.0M 4s 2024-09-14T21:24:55.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 61950K .......... .......... .......... .......... .......... 36% 24.1M 4s 2024-09-14T21:24:55.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62000K .......... .......... .......... .......... .......... 36% 43.7M 4s 2024-09-14T21:24:55.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62050K .......... .......... .......... .......... .......... 36% 24.3M 4s 2024-09-14T21:24:55.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62100K .......... .......... .......... .......... .......... 36% 39.2M 4s 2024-09-14T21:24:55.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62150K .......... .......... .......... .......... .......... 36% 20.7M 4s 2024-09-14T21:24:55.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62200K .......... .......... .......... .......... .......... 36% 24.4M 4s 2024-09-14T21:24:55.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62250K .......... .......... .......... .......... .......... 36% 51.0M 4s 2024-09-14T21:24:55.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62300K .......... .......... .......... .......... .......... 36% 26.6M 4s 2024-09-14T21:24:55.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62350K .......... .......... .......... .......... .......... 37% 24.8M 4s 2024-09-14T21:24:55.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62400K .......... .......... .......... .......... .......... 37% 35.1M 4s 2024-09-14T21:24:55.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62450K .......... .......... .......... .......... .......... 37% 25.9M 4s 2024-09-14T21:24:55.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62500K .......... .......... .......... .......... .......... 37% 48.7M 4s 2024-09-14T21:24:55.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62550K .......... .......... .......... .......... .......... 37% 21.3M 4s 2024-09-14T21:24:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62600K .......... .......... .......... .......... .......... 37% 40.5M 4s 2024-09-14T21:24:55.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62650K .......... .......... .......... .......... .......... 37% 25.9M 4s 2024-09-14T21:24:55.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62700K .......... .......... .......... .......... .......... 37% 21.6M 4s 2024-09-14T21:24:55.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62750K .......... .......... .......... .......... .......... 37% 24.9M 4s 2024-09-14T21:24:55.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62800K .......... .......... .......... .......... .......... 37% 49.3M 4s 2024-09-14T21:24:55.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62850K .......... .......... .......... .......... .......... 37% 25.2M 4s 2024-09-14T21:24:55.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62900K .......... .......... .......... .......... .......... 37% 37.6M 4s 2024-09-14T21:24:55.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 62950K .......... .......... .......... .......... .......... 37% 23.5M 4s 2024-09-14T21:24:55.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63000K .......... .......... .......... .......... .......... 37% 48.8M 4s 2024-09-14T21:24:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63050K .......... .......... .......... .......... .......... 37% 23.9M 4s 2024-09-14T21:24:55.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63100K .......... .......... .......... .......... .......... 37% 32.8M 4s 2024-09-14T21:24:55.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63150K .......... .......... .......... .......... .......... 37% 26.7M 4s 2024-09-14T21:24:55.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63200K .......... .......... .......... .......... .......... 37% 24.4M 4s 2024-09-14T21:24:55.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63250K .......... .......... .......... .......... .......... 37% 30.9M 4s 2024-09-14T21:24:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63300K .......... .......... .......... .......... .......... 37% 38.2M 4s 2024-09-14T21:24:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63350K .......... .......... .......... .......... .......... 37% 27.2M 4s 2024-09-14T21:24:55.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63400K .......... .......... .......... .......... .......... 37% 24.2M 4s 2024-09-14T21:24:55.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63450K .......... .......... .......... .......... .......... 37% 27.4M 4s 2024-09-14T21:24:55.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63500K .......... .......... .......... .......... .......... 37% 48.3M 4s 2024-09-14T21:24:55.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63550K .......... .......... .......... .......... .......... 37% 22.7M 4s 2024-09-14T21:24:55.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63600K .......... .......... .......... .......... .......... 37% 26.3M 4s 2024-09-14T21:24:55.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63650K .......... .......... .......... .......... .......... 37% 39.7M 4s 2024-09-14T21:24:55.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63700K .......... .......... .......... .......... .......... 37% 20.7M 4s 2024-09-14T21:24:55.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63750K .......... .......... .......... .......... .......... 37% 62.9M 4s 2024-09-14T21:24:55.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63800K .......... .......... .......... .......... .......... 37% 25.5M 4s 2024-09-14T21:24:55.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63850K .......... .......... .......... .......... .......... 37% 25.5M 4s 2024-09-14T21:24:55.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63900K .......... .......... .......... .......... .......... 37% 32.3M 4s 2024-09-14T21:24:55.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 63950K .......... .......... .......... .......... .......... 37% 24.7M 4s 2024-09-14T21:24:55.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64000K .......... .......... .......... .......... .......... 37% 30.2M 4s 2024-09-14T21:24:55.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64050K .......... .......... .......... .......... .......... 38% 38.9M 4s 2024-09-14T21:24:55.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64100K .......... .......... .......... .......... .......... 38% 21.8M 4s 2024-09-14T21:24:55.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64150K .......... .......... .......... .......... .......... 38% 35.3M 4s 2024-09-14T21:24:55.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64200K .......... .......... .......... .......... .......... 38% 24.1M 4s 2024-09-14T21:24:55.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64250K .......... .......... .......... .......... .......... 38% 68.2M 4s 2024-09-14T21:24:55.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64300K .......... .......... .......... .......... .......... 38% 22.2M 4s 2024-09-14T21:24:55.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64350K .......... .......... .......... .......... .......... 38% 27.2M 4s 2024-09-14T21:24:55.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64400K .......... .......... .......... .......... .......... 38% 32.0M 4s 2024-09-14T21:24:55.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64450K .......... .......... .......... .......... .......... 38% 21.7M 4s 2024-09-14T21:24:55.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64500K .......... .......... .......... .......... .......... 38% 25.7M 4s 2024-09-14T21:24:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64550K .......... .......... .......... .......... .......... 38% 72.3M 4s 2024-09-14T21:24:55.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64600K .......... .......... .......... .......... .......... 38% 25.2M 4s 2024-09-14T21:24:55.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64650K .......... .......... .......... .......... .......... 38% 31.7M 4s 2024-09-14T21:24:55.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64700K .......... .......... .......... .......... .......... 38% 20.1M 4s 2024-09-14T21:24:55.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64750K .......... .......... .......... .......... .......... 38% 29.1M 4s 2024-09-14T21:24:55.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64800K .......... .......... .......... .......... .......... 38% 47.1M 4s 2024-09-14T21:24:55.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64850K .......... .......... .......... .......... .......... 38% 23.9M 4s 2024-09-14T21:24:55.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64900K .......... .......... .......... .......... .......... 38% 41.4M 4s 2024-09-14T21:24:55.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 64950K .......... .......... .......... .......... .......... 38% 22.7M 4s 2024-09-14T21:24:55.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65000K .......... .......... .......... .......... .......... 38% 23.6M 4s 2024-09-14T21:24:55.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65050K .......... .......... .......... .......... .......... 38% 48.0M 4s 2024-09-14T21:24:55.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65100K .......... .......... .......... .......... .......... 38% 26.3M 4s 2024-09-14T21:24:55.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65150K .......... .......... .......... .......... .......... 38% 23.7M 4s 2024-09-14T21:24:55.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65200K .......... .......... .......... .......... .......... 38% 34.9M 4s 2024-09-14T21:24:55.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65250K .......... .......... .......... .......... .......... 38% 26.9M 4s 2024-09-14T21:24:55.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65300K .......... .......... .......... .......... .......... 38% 44.0M 4s 2024-09-14T21:24:55.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65350K .......... .......... .......... .......... .......... 38% 24.9M 4s 2024-09-14T21:24:55.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65400K .......... .......... .......... .......... .......... 38% 37.3M 4s 2024-09-14T21:24:55.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65450K .......... .......... .......... .......... .......... 38% 24.5M 4s 2024-09-14T21:24:55.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65500K .......... .......... .......... .......... .......... 38% 47.3M 4s 2024-09-14T21:24:55.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65550K .......... .......... .......... .......... .......... 38% 15.1M 4s 2024-09-14T21:24:55.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65600K .......... .......... .......... .......... .......... 38% 60.9M 4s 2024-09-14T21:24:55.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65650K .......... .......... .......... .......... .......... 38% 22.9M 4s 2024-09-14T21:24:55.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65700K .......... .......... .......... .......... .......... 39% 42.7M 4s 2024-09-14T21:24:55.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65750K .......... .......... .......... .......... .......... 39% 23.8M 4s 2024-09-14T21:24:55.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65800K .......... .......... .......... .......... .......... 39% 39.7M 4s 2024-09-14T21:24:55.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65850K .......... .......... .......... .......... .......... 39% 20.8M 4s 2024-09-14T21:24:55.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65900K .......... .......... .......... .......... .......... 39% 36.2M 4s 2024-09-14T21:24:55.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 65950K .......... .......... .......... .......... .......... 39% 23.4M 4s 2024-09-14T21:24:55.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66000K .......... .......... .......... .......... .......... 39% 27.8M 4s 2024-09-14T21:24:55.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66050K .......... .......... .......... .......... .......... 39% 39.2M 4s 2024-09-14T21:24:55.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66100K .......... .......... .......... .......... .......... 39% 25.3M 4s 2024-09-14T21:24:55.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66150K .......... .......... .......... .......... .......... 39% 28.9M 4s 2024-09-14T21:24:55.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66200K .......... .......... .......... .......... .......... 39% 28.8M 4s 2024-09-14T21:24:55.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66250K .......... .......... .......... .......... .......... 39% 24.4M 4s 2024-09-14T21:24:55.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66300K .......... .......... .......... .......... .......... 39% 36.0M 4s 2024-09-14T21:24:55.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66350K .......... .......... .......... .......... .......... 39% 24.3M 4s 2024-09-14T21:24:55.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66400K .......... .......... .......... .......... .......... 39% 28.2M 4s 2024-09-14T21:24:55.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66450K .......... .......... .......... .......... .......... 39% 37.8M 4s 2024-09-14T21:24:55.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66500K .......... .......... .......... .......... .......... 39% 24.2M 4s 2024-09-14T21:24:55.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66550K .......... .......... .......... .......... .......... 39% 49.9M 4s 2024-09-14T21:24:55.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66600K .......... .......... .......... .......... .......... 39% 23.7M 4s 2024-09-14T21:24:55.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66650K .......... .......... .......... .......... .......... 39% 22.4M 4s 2024-09-14T21:24:55.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66700K .......... .......... .......... .......... .......... 39% 67.7M 4s 2024-09-14T21:24:55.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66750K .......... .......... .......... .......... .......... 39% 15.9M 4s 2024-09-14T21:24:55.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66800K .......... .......... .......... .......... .......... 39% 29.4M 4s 2024-09-14T21:24:55.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66850K .......... .......... .......... .......... .......... 39% 48.0M 4s 2024-09-14T21:24:55.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66900K .......... .......... .......... .......... .......... 39% 29.4M 4s 2024-09-14T21:24:55.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 66950K .......... .......... .......... .......... .......... 39% 34.6M 4s 2024-09-14T21:24:55.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67000K .......... .......... .......... .......... .......... 39% 24.4M 4s 2024-09-14T21:24:55.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67050K .......... .......... .......... .......... .......... 39% 44.5M 4s 2024-09-14T21:24:55.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67100K .......... .......... .......... .......... .......... 39% 26.3M 4s 2024-09-14T21:24:55.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67150K .......... .......... .......... .......... .......... 39% 23.3M 4s 2024-09-14T21:24:55.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67200K .......... .......... .......... .......... .......... 39% 21.6M 4s 2024-09-14T21:24:55.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67250K .......... .......... .......... .......... .......... 39% 43.8M 4s 2024-09-14T21:24:55.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67300K .......... .......... .......... .......... .......... 39% 24.1M 4s 2024-09-14T21:24:55.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67350K .......... .......... .......... .......... .......... 39% 53.1M 4s 2024-09-14T21:24:55.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67400K .......... .......... .......... .......... .......... 40% 19.5M 4s 2024-09-14T21:24:55.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67450K .......... .......... .......... .......... .......... 40% 35.2M 4s 2024-09-14T21:24:55.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67500K .......... .......... .......... .......... .......... 40% 28.0M 4s 2024-09-14T21:24:55.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67550K .......... .......... .......... .......... .......... 40% 26.6M 4s 2024-09-14T21:24:55.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67600K .......... .......... .......... .......... .......... 40% 51.4M 4s 2024-09-14T21:24:55.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67650K .......... .......... .......... .......... .......... 40% 21.8M 4s 2024-09-14T21:24:55.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67700K .......... .......... .......... .......... .......... 40% 35.8M 3s 2024-09-14T21:24:55.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67750K .......... .......... .......... .......... .......... 40% 25.2M 3s 2024-09-14T21:24:55.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67800K .......... .......... .......... .......... .......... 40% 25.4M 3s 2024-09-14T21:24:55.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67850K .......... .......... .......... .......... .......... 40% 42.2M 3s 2024-09-14T21:24:55.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67900K .......... .......... .......... .......... .......... 40% 24.3M 3s 2024-09-14T21:24:55.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 67950K .......... .......... .......... .......... .......... 40% 23.5M 3s 2024-09-14T21:24:55.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68000K .......... .......... .......... .......... .......... 40% 39.3M 3s 2024-09-14T21:24:55.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68050K .......... .......... .......... .......... .......... 40% 27.2M 3s 2024-09-14T21:24:55.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68100K .......... .......... .......... .......... .......... 40% 44.3M 3s 2024-09-14T21:24:55.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68150K .......... .......... .......... .......... .......... 40% 22.6M 3s 2024-09-14T21:24:55.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68200K .......... .......... .......... .......... .......... 40% 41.2M 3s 2024-09-14T21:24:55.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68250K .......... .......... .......... .......... .......... 40% 26.1M 3s 2024-09-14T21:24:55.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68300K .......... .......... .......... .......... .......... 40% 43.8M 3s 2024-09-14T21:24:55.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68350K .......... .......... .......... .......... .......... 40% 14.3M 3s 2024-09-14T21:24:55.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68400K .......... .......... .......... .......... .......... 40% 77.3M 3s 2024-09-14T21:24:55.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68450K .......... .......... .......... .......... .......... 40% 23.3M 3s 2024-09-14T21:24:55.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68500K .......... .......... .......... .......... .......... 40% 38.4M 3s 2024-09-14T21:24:55.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68550K .......... .......... .......... .......... .......... 40% 19.9M 3s 2024-09-14T21:24:55.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68600K .......... .......... .......... .......... .......... 40% 85.1M 3s 2024-09-14T21:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68650K .......... .......... .......... .......... .......... 40% 24.0M 3s 2024-09-14T21:24:55.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68700K .......... .......... .......... .......... .......... 40% 38.0M 3s 2024-09-14T21:24:55.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68750K .......... .......... .......... .......... .......... 40% 23.3M 3s 2024-09-14T21:24:55.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68800K .......... .......... .......... .......... .......... 40% 26.4M 3s 2024-09-14T21:24:55.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68850K .......... .......... .......... .......... .......... 40% 40.0M 3s 2024-09-14T21:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68900K .......... .......... .......... .......... .......... 40% 32.6M 3s 2024-09-14T21:24:55.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 68950K .......... .......... .......... .......... .......... 40% 25.5M 3s 2024-09-14T21:24:55.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69000K .......... .......... .......... .......... .......... 40% 25.9M 3s 2024-09-14T21:24:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69050K .......... .......... .......... .......... .......... 40% 20.4M 3s 2024-09-14T21:24:55.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69100K .......... .......... .......... .......... .......... 41% 93.1M 3s 2024-09-14T21:24:55.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69150K .......... .......... .......... .......... .......... 41% 22.3M 3s 2024-09-14T21:24:55.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69200K .......... .......... .......... .......... .......... 41% 18.7M 3s 2024-09-14T21:24:55.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69250K .......... .......... .......... .......... .......... 41% 37.5M 3s 2024-09-14T21:24:55.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69300K .......... .......... .......... .......... .......... 41% 23.0M 3s 2024-09-14T21:24:55.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69350K .......... .......... .......... .......... .......... 41% 50.8M 3s 2024-09-14T21:24:55.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69400K .......... .......... .......... .......... .......... 41% 26.0M 3s 2024-09-14T21:24:55.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69450K .......... .......... .......... .......... .......... 41% 34.2M 3s 2024-09-14T21:24:55.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69500K .......... .......... .......... .......... .......... 41% 22.4M 3s 2024-09-14T21:24:55.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69550K .......... .......... .......... .......... .......... 41% 26.2M 3s 2024-09-14T21:24:55.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69600K .......... .......... .......... .......... .......... 41% 23.4M 3s 2024-09-14T21:24:55.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69650K .......... .......... .......... .......... .......... 41% 60.2M 3s 2024-09-14T21:24:55.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69700K .......... .......... .......... .......... .......... 41% 23.8M 3s 2024-09-14T21:24:55.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69750K .......... .......... .......... .......... .......... 41% 38.5M 3s 2024-09-14T21:24:55.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69800K .......... .......... .......... .......... .......... 41% 18.8M 3s 2024-09-14T21:24:55.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69850K .......... .......... .......... .......... .......... 41% 112M 3s 2024-09-14T21:24:55.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69900K .......... .......... .......... .......... .......... 41% 24.9M 3s 2024-09-14T21:24:55.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 69950K .......... .......... .......... .......... .......... 41% 23.1M 3s 2024-09-14T21:24:55.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70000K .......... .......... .......... .......... .......... 41% 35.0M 3s 2024-09-14T21:24:55.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70050K .......... .......... .......... .......... .......... 41% 21.0M 3s 2024-09-14T21:24:55.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70100K .......... .......... .......... .......... .......... 41% 29.1M 3s 2024-09-14T21:24:55.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70150K .......... .......... .......... .......... .......... 41% 35.8M 3s 2024-09-14T21:24:55.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70200K .......... .......... .......... .......... .......... 41% 30.3M 3s 2024-09-14T21:24:55.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70250K .......... .......... .......... .......... .......... 41% 34.3M 3s 2024-09-14T21:24:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70300K .......... .......... .......... .......... .......... 41% 23.6M 3s 2024-09-14T21:24:55.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70350K .......... .......... .......... .......... .......... 41% 21.9M 3s 2024-09-14T21:24:55.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70400K .......... .......... .......... .......... .......... 41% 77.3M 3s 2024-09-14T21:24:55.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70450K .......... .......... .......... .......... .......... 41% 20.5M 3s 2024-09-14T21:24:55.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70500K .......... .......... .......... .......... .......... 41% 28.9M 3s 2024-09-14T21:24:55.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70550K .......... .......... .......... .......... .......... 41% 41.4M 3s 2024-09-14T21:24:55.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70600K .......... .......... .......... .......... .......... 41% 32.2M 3s 2024-09-14T21:24:55.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70650K .......... .......... .......... .......... .......... 41% 31.1M 3s 2024-09-14T21:24:55.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70700K .......... .......... .......... .......... .......... 41% 25.8M 3s 2024-09-14T21:24:55.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70750K .......... .......... .......... .......... .......... 42% 19.5M 3s 2024-09-14T21:24:55.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70800K .......... .......... .......... .......... .......... 42% 34.8M 3s 2024-09-14T21:24:55.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70850K .......... .......... .......... .......... .......... 42% 65.2M 3s 2024-09-14T21:24:55.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70900K .......... .......... .......... .......... .......... 42% 18.6M 3s 2024-09-14T21:24:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 70950K .......... .......... .......... .......... .......... 42% 29.5M 3s 2024-09-14T21:24:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71000K .......... .......... .......... .......... .......... 42% 58.9M 3s 2024-09-14T21:24:55.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71050K .......... .......... .......... .......... .......... 42% 22.2M 3s 2024-09-14T21:24:55.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71100K .......... .......... .......... .......... .......... 42% 48.0M 3s 2024-09-14T21:24:55.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71150K .......... .......... .......... .......... .......... 42% 24.2M 3s 2024-09-14T21:24:55.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71200K .......... .......... .......... .......... .......... 42% 24.8M 3s 2024-09-14T21:24:55.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71250K .......... .......... .......... .......... .......... 42% 34.6M 3s 2024-09-14T21:24:55.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71300K .......... .......... .......... .......... .......... 42% 19.3M 3s 2024-09-14T21:24:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71350K .......... .......... .......... .......... .......... 42% 43.7M 3s 2024-09-14T21:24:55.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71400K .......... .......... .......... .......... .......... 42% 29.2M 3s 2024-09-14T21:24:55.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71450K .......... .......... .......... .......... .......... 42% 22.6M 3s 2024-09-14T21:24:55.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71500K .......... .......... .......... .......... .......... 42% 40.2M 3s 2024-09-14T21:24:55.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71550K .......... .......... .......... .......... .......... 42% 20.6M 3s 2024-09-14T21:24:55.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71600K .......... .......... .......... .......... .......... 42% 31.4M 3s 2024-09-14T21:24:55.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71650K .......... .......... .......... .......... .......... 42% 41.0M 3s 2024-09-14T21:24:55.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71700K .......... .......... .......... .......... .......... 42% 28.1M 3s 2024-09-14T21:24:55.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71750K .......... .......... .......... .......... .......... 42% 29.2M 3s 2024-09-14T21:24:55.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71800K .......... .......... .......... .......... .......... 42% 27.0M 3s 2024-09-14T21:24:55.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71850K .......... .......... .......... .......... .......... 42% 25.6M 3s 2024-09-14T21:24:55.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71900K .......... .......... .......... .......... .......... 42% 49.2M 3s 2024-09-14T21:24:55.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 71950K .......... .......... .......... .......... .......... 42% 25.6M 3s 2024-09-14T21:24:55.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72000K .......... .......... .......... .......... .......... 42% 22.1M 3s 2024-09-14T21:24:55.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72050K .......... .......... .......... .......... .......... 42% 42.3M 3s 2024-09-14T21:24:55.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72100K .......... .......... .......... .......... .......... 42% 24.3M 3s 2024-09-14T21:24:55.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72150K .......... .......... .......... .......... .......... 42% 47.0M 3s 2024-09-14T21:24:55.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72200K .......... .......... .......... .......... .......... 42% 28.9M 3s 2024-09-14T21:24:55.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72250K .......... .......... .......... .......... .......... 42% 28.2M 3s 2024-09-14T21:24:55.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72300K .......... .......... .......... .......... .......... 42% 30.7M 3s 2024-09-14T21:24:55.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72350K .......... .......... .......... .......... .......... 42% 21.0M 3s 2024-09-14T21:24:55.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72400K .......... .......... .......... .......... .......... 42% 23.6M 3s 2024-09-14T21:24:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72450K .......... .......... .......... .......... .......... 43% 38.1M 3s 2024-09-14T21:24:55.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72500K .......... .......... .......... .......... .......... 43% 29.6M 3s 2024-09-14T21:24:55.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72550K .......... .......... .......... .......... .......... 43% 33.3M 3s 2024-09-14T21:24:55.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72600K .......... .......... .......... .......... .......... 43% 14.1M 3s 2024-09-14T21:24:55.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72650K .......... .......... .......... .......... .......... 43% 44.7M 3s 2024-09-14T21:24:55.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72700K .......... .......... .......... .......... .......... 43% 24.2M 3s 2024-09-14T21:24:55.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72750K .......... .......... .......... .......... .......... 43% 24.6M 3s 2024-09-14T21:24:55.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72800K .......... .......... .......... .......... .......... 43% 36.1M 3s 2024-09-14T21:24:55.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72850K .......... .......... .......... .......... .......... 43% 25.2M 3s 2024-09-14T21:24:55.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72900K .......... .......... .......... .......... .......... 43% 23.1M 3s 2024-09-14T21:24:55.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 72950K .......... .......... .......... .......... .......... 43% 54.0M 3s 2024-09-14T21:24:55.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73000K .......... .......... .......... .......... .......... 43% 30.5M 3s 2024-09-14T21:24:55.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73050K .......... .......... .......... .......... .......... 43% 28.6M 3s 2024-09-14T21:24:55.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73100K .......... .......... .......... .......... .......... 43% 23.4M 3s 2024-09-14T21:24:55.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73150K .......... .......... .......... .......... .......... 43% 22.8M 3s 2024-09-14T21:24:55.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73200K .......... .......... .......... .......... .......... 43% 50.1M 3s 2024-09-14T21:24:55.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73250K .......... .......... .......... .......... .......... 43% 25.2M 3s 2024-09-14T21:24:55.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73300K .......... .......... .......... .......... .......... 43% 34.9M 3s 2024-09-14T21:24:55.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73350K .......... .......... .......... .......... .......... 43% 27.0M 3s 2024-09-14T21:24:55.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73400K .......... .......... .......... .......... .......... 43% 42.6M 3s 2024-09-14T21:24:55.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73450K .......... .......... .......... .......... .......... 43% 22.4M 3s 2024-09-14T21:24:55.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73500K .......... .......... .......... .......... .......... 43% 37.1M 3s 2024-09-14T21:24:55.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73550K .......... .......... .......... .......... .......... 43% 25.6M 3s 2024-09-14T21:24:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73600K .......... .......... .......... .......... .......... 43% 26.3M 3s 2024-09-14T21:24:55.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73650K .......... .......... .......... .......... .......... 43% 21.5M 3s 2024-09-14T21:24:55.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73700K .......... .......... .......... .......... .......... 43% 58.8M 3s 2024-09-14T21:24:55.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73750K .......... .......... .......... .......... .......... 43% 30.9M 3s 2024-09-14T21:24:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73800K .......... .......... .......... .......... .......... 43% 22.9M 3s 2024-09-14T21:24:55.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73850K .......... .......... .......... .......... .......... 43% 27.9M 3s 2024-09-14T21:24:55.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73900K .......... .......... .......... .......... .......... 43% 44.3M 3s 2024-09-14T21:24:55.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 73950K .......... .......... .......... .......... .......... 43% 22.7M 3s 2024-09-14T21:24:55.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74000K .......... .......... .......... .......... .......... 43% 28.3M 3s 2024-09-14T21:24:55.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74050K .......... .......... .......... .......... .......... 43% 39.5M 3s 2024-09-14T21:24:55.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74100K .......... .......... .......... .......... .......... 43% 24.4M 3s 2024-09-14T21:24:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74150K .......... .......... .......... .......... .......... 44% 23.9M 3s 2024-09-14T21:24:55.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74200K .......... .......... .......... .......... .......... 44% 36.3M 3s 2024-09-14T21:24:55.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74250K .......... .......... .......... .......... .......... 44% 27.3M 3s 2024-09-14T21:24:55.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74300K .......... .......... .......... .......... .......... 44% 35.7M 3s 2024-09-14T21:24:55.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74350K .......... .......... .......... .......... .......... 44% 25.4M 3s 2024-09-14T21:24:55.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74400K .......... .......... .......... .......... .......... 44% 24.0M 3s 2024-09-14T21:24:55.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74450K .......... .......... .......... .......... .......... 44% 39.0M 3s 2024-09-14T21:24:55.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74500K .......... .......... .......... .......... .......... 44% 29.2M 3s 2024-09-14T21:24:55.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74550K .......... .......... .......... .......... .......... 44% 22.9M 3s 2024-09-14T21:24:55.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74600K .......... .......... .......... .......... .......... 44% 39.8M 3s 2024-09-14T21:24:55.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74650K .......... .......... .......... .......... .......... 44% 23.8M 3s 2024-09-14T21:24:55.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74700K .......... .......... .......... .......... .......... 44% 49.7M 3s 2024-09-14T21:24:55.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74750K .......... .......... .......... .......... .......... 44% 22.8M 3s 2024-09-14T21:24:55.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74800K .......... .......... .......... .......... .......... 44% 27.0M 3s 2024-09-14T21:24:55.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74850K .......... .......... .......... .......... .......... 44% 34.1M 3s 2024-09-14T21:24:55.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74900K .......... .......... .......... .......... .......... 44% 25.0M 3s 2024-09-14T21:24:55.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 74950K .......... .......... .......... .......... .......... 44% 45.8M 3s 2024-09-14T21:24:55.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75000K .......... .......... .......... .......... .......... 44% 29.7M 3s 2024-09-14T21:24:55.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75050K .......... .......... .......... .......... .......... 44% 31.4M 3s 2024-09-14T21:24:55.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75100K .......... .......... .......... .......... .......... 44% 22.5M 3s 2024-09-14T21:24:55.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75150K .......... .......... .......... .......... .......... 44% 22.4M 3s 2024-09-14T21:24:55.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75200K .......... .......... .......... .......... .......... 44% 26.8M 3s 2024-09-14T21:24:55.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75250K .......... .......... .......... .......... .......... 44% 49.3M 3s 2024-09-14T21:24:55.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75300K .......... .......... .......... .......... .......... 44% 24.5M 3s 2024-09-14T21:24:55.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75350K .......... .......... .......... .......... .......... 44% 34.4M 3s 2024-09-14T21:24:55.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75400K .......... .......... .......... .......... .......... 44% 25.1M 3s 2024-09-14T21:24:55.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75450K .......... .......... .......... .......... .......... 44% 47.3M 3s 2024-09-14T21:24:55.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75500K .......... .......... .......... .......... .......... 44% 29.1M 3s 2024-09-14T21:24:55.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75550K .......... .......... .......... .......... .......... 44% 20.4M 3s 2024-09-14T21:24:55.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75600K .......... .......... .......... .......... .......... 44% 37.6M 3s 2024-09-14T21:24:55.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75650K .......... .......... .......... .......... .......... 44% 24.2M 3s 2024-09-14T21:24:55.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75700K .......... .......... .......... .......... .......... 44% 24.2M 3s 2024-09-14T21:24:55.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75750K .......... .......... .......... .......... .......... 44% 47.6M 3s 2024-09-14T21:24:55.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75800K .......... .......... .......... .......... .......... 44% 35.9M 3s 2024-09-14T21:24:55.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75850K .......... .......... .......... .......... .......... 45% 23.6M 3s 2024-09-14T21:24:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75900K .......... .......... .......... .......... .......... 45% 25.1M 3s 2024-09-14T21:24:55.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 75950K .......... .......... .......... .......... .......... 45% 24.5M 3s 2024-09-14T21:24:55.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76000K .......... .......... .......... .......... .......... 45% 47.8M 3s 2024-09-14T21:24:55.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76050K .......... .......... .......... .......... .......... 45% 32.4M 3s 2024-09-14T21:24:55.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76100K .......... .......... .......... .......... .......... 45% 22.1M 3s 2024-09-14T21:24:55.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76150K .......... .......... .......... .......... .......... 45% 28.3M 3s 2024-09-14T21:24:55.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76200K .......... .......... .......... .......... .......... 45% 47.6M 3s 2024-09-14T21:24:55.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76250K .......... .......... .......... .......... .......... 45% 22.6M 3s 2024-09-14T21:24:55.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76300K .......... .......... .......... .......... .......... 45% 33.8M 3s 2024-09-14T21:24:55.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76350K .......... .......... .......... .......... .......... 45% 24.4M 3s 2024-09-14T21:24:55.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76400K .......... .......... .......... .......... .......... 45% 26.8M 3s 2024-09-14T21:24:55.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76450K .......... .......... .......... .......... .......... 45% 25.3M 3s 2024-09-14T21:24:55.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76500K .......... .......... .......... .......... .......... 45% 29.2M 3s 2024-09-14T21:24:55.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76550K .......... .......... .......... .......... .......... 45% 22.2M 3s 2024-09-14T21:24:55.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76600K .......... .......... .......... .......... .......... 45% 114M 3s 2024-09-14T21:24:55.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76650K .......... .......... .......... .......... .......... 45% 16.6M 3s 2024-09-14T21:24:55.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76700K .......... .......... .......... .......... .......... 45% 27.4M 3s 2024-09-14T21:24:55.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76750K .......... .......... .......... .......... .......... 45% 31.7M 3s 2024-09-14T21:24:55.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76800K .......... .......... .......... .......... .......... 45% 40.7M 3s 2024-09-14T21:24:55.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76850K .......... .......... .......... .......... .......... 45% 33.0M 3s 2024-09-14T21:24:55.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76900K .......... .......... .......... .......... .......... 45% 30.0M 3s 2024-09-14T21:24:55.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 76950K .......... .......... .......... .......... .......... 45% 22.7M 3s 2024-09-14T21:24:55.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77000K .......... .......... .......... .......... .......... 45% 66.4M 3s 2024-09-14T21:24:55.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77050K .......... .......... .......... .......... .......... 45% 23.3M 3s 2024-09-14T21:24:55.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77100K .......... .......... .......... .......... .......... 45% 31.0M 3s 2024-09-14T21:24:55.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77150K .......... .......... .......... .......... .......... 45% 28.5M 3s 2024-09-14T21:24:55.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77200K .......... .......... .......... .......... .......... 45% 24.5M 3s 2024-09-14T21:24:55.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77250K .......... .......... .......... .......... .......... 45% 38.3M 3s 2024-09-14T21:24:55.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77300K .......... .......... .......... .......... .......... 45% 27.5M 3s 2024-09-14T21:24:55.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77350K .......... .......... .......... .......... .......... 45% 30.0M 3s 2024-09-14T21:24:55.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77400K .......... .......... .......... .......... .......... 45% 24.1M 3s 2024-09-14T21:24:55.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77450K .......... .......... .......... .......... .......... 45% 23.1M 3s 2024-09-14T21:24:55.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77500K .......... .......... .......... .......... .......... 46% 96.5M 3s 2024-09-14T21:24:55.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77550K .......... .......... .......... .......... .......... 46% 19.0M 3s 2024-09-14T21:24:55.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77600K .......... .......... .......... .......... .......... 46% 28.4M 3s 2024-09-14T21:24:55.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77650K .......... .......... .......... .......... .......... 46% 41.0M 3s 2024-09-14T21:24:55.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77700K .......... .......... .......... .......... .......... 46% 28.4M 3s 2024-09-14T21:24:55.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77750K .......... .......... .......... .......... .......... 46% 36.4M 3s 2024-09-14T21:24:55.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77800K .......... .......... .......... .......... .......... 46% 25.2M 3s 2024-09-14T21:24:55.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77850K .......... .......... .......... .......... .......... 46% 33.3M 3s 2024-09-14T21:24:55.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77900K .......... .......... .......... .......... .......... 46% 25.5M 3s 2024-09-14T21:24:55.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 77950K .......... .......... .......... .......... .......... 46% 27.8M 3s 2024-09-14T21:24:55.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78000K .......... .......... .......... .......... .......... 46% 20.8M 3s 2024-09-14T21:24:55.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78050K .......... .......... .......... .......... .......... 46% 58.7M 3s 2024-09-14T21:24:55.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78100K .......... .......... .......... .......... .......... 46% 33.5M 3s 2024-09-14T21:24:56.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78150K .......... .......... .......... .......... .......... 46% 24.9M 3s 2024-09-14T21:24:56.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78200K .......... .......... .......... .......... .......... 46% 23.3M 3s 2024-09-14T21:24:56.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78250K .......... .......... .......... .......... .......... 46% 45.9M 3s 2024-09-14T21:24:56.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78300K .......... .......... .......... .......... .......... 46% 25.1M 3s 2024-09-14T21:24:56.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78350K .......... .......... .......... .......... .......... 46% 24.4M 3s 2024-09-14T21:24:56.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78400K .......... .......... .......... .......... .......... 46% 39.5M 3s 2024-09-14T21:24:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78450K .......... .......... .......... .......... .......... 46% 24.6M 3s 2024-09-14T21:24:56.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78500K .......... .......... .......... .......... .......... 46% 43.0M 3s 2024-09-14T21:24:56.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78550K .......... .......... .......... .......... .......... 46% 23.5M 3s 2024-09-14T21:24:56.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78600K .......... .......... .......... .......... .......... 46% 41.1M 3s 2024-09-14T21:24:56.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78650K .......... .......... .......... .......... .......... 46% 25.4M 3s 2024-09-14T21:24:56.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78700K .......... .......... .......... .......... .......... 46% 21.5M 3s 2024-09-14T21:24:56.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78750K .......... .......... .......... .......... .......... 46% 24.1M 3s 2024-09-14T21:24:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78800K .......... .......... .......... .......... .......... 46% 44.0M 3s 2024-09-14T21:24:56.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78850K .......... .......... .......... .......... .......... 46% 26.8M 3s 2024-09-14T21:24:56.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78900K .......... .......... .......... .......... .......... 46% 27.2M 3s 2024-09-14T21:24:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 78950K .......... .......... .......... .......... .......... 46% 25.7M 3s 2024-09-14T21:24:56.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79000K .......... .......... .......... .......... .......... 46% 69.2M 3s 2024-09-14T21:24:56.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79050K .......... .......... .......... .......... .......... 46% 25.5M 3s 2024-09-14T21:24:56.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79100K .......... .......... .......... .......... .......... 46% 30.3M 3s 2024-09-14T21:24:56.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79150K .......... .......... .......... .......... .......... 46% 24.7M 3s 2024-09-14T21:24:56.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79200K .......... .......... .......... .......... .......... 47% 26.0M 3s 2024-09-14T21:24:56.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79250K .......... .......... .......... .......... .......... 47% 33.0M 3s 2024-09-14T21:24:56.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79300K .......... .......... .......... .......... .......... 47% 25.8M 3s 2024-09-14T21:24:56.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79350K .......... .......... .......... .......... .......... 47% 32.0M 3s 2024-09-14T21:24:56.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79400K .......... .......... .......... .......... .......... 47% 29.8M 3s 2024-09-14T21:24:56.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79450K .......... .......... .......... .......... .......... 47% 29.0M 3s 2024-09-14T21:24:56.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79500K .......... .......... .......... .......... .......... 47% 47.0M 3s 2024-09-14T21:24:56.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79550K .......... .......... .......... .......... .......... 47% 24.3M 3s 2024-09-14T21:24:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79600K .......... .......... .......... .......... .......... 47% 23.3M 3s 2024-09-14T21:24:56.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79650K .......... .......... .......... .......... .......... 47% 38.3M 3s 2024-09-14T21:24:56.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79700K .......... .......... .......... .......... .......... 47% 29.3M 3s 2024-09-14T21:24:56.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79750K .......... .......... .......... .......... .......... 47% 20.3M 3s 2024-09-14T21:24:56.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79800K .......... .......... .......... .......... .......... 47% 44.2M 3s 2024-09-14T21:24:56.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79850K .......... .......... .......... .......... .......... 47% 26.9M 3s 2024-09-14T21:24:56.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79900K .......... .......... .......... .......... .......... 47% 27.8M 3s 2024-09-14T21:24:56.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 79950K .......... .......... .......... .......... .......... 47% 25.9M 3s 2024-09-14T21:24:56.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80000K .......... .......... .......... .......... .......... 47% 24.0M 3s 2024-09-14T21:24:56.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80050K .......... .......... .......... .......... .......... 47% 51.7M 3s 2024-09-14T21:24:56.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80100K .......... .......... .......... .......... .......... 47% 25.7M 3s 2024-09-14T21:24:56.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80150K .......... .......... .......... .......... .......... 47% 34.0M 3s 2024-09-14T21:24:56.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80200K .......... .......... .......... .......... .......... 47% 25.2M 3s 2024-09-14T21:24:56.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80250K .......... .......... .......... .......... .......... 47% 21.3M 3s 2024-09-14T21:24:56.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80300K .......... .......... .......... .......... .......... 47% 63.6M 3s 2024-09-14T21:24:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80350K .......... .......... .......... .......... .......... 47% 24.5M 3s 2024-09-14T21:24:56.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80400K .......... .......... .......... .......... .......... 47% 35.2M 3s 2024-09-14T21:24:56.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80450K .......... .......... .......... .......... .......... 47% 23.5M 3s 2024-09-14T21:24:56.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80500K .......... .......... .......... .......... .......... 47% 24.2M 3s 2024-09-14T21:24:56.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80550K .......... .......... .......... .......... .......... 47% 41.4M 3s 2024-09-14T21:24:56.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80600K .......... .......... .......... .......... .......... 47% 24.3M 3s 2024-09-14T21:24:56.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80650K .......... .......... .......... .......... .......... 47% 46.8M 3s 2024-09-14T21:24:56.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80700K .......... .......... .......... .......... .......... 47% 22.7M 3s 2024-09-14T21:24:56.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80750K .......... .......... .......... .......... .......... 47% 25.2M 3s 2024-09-14T21:24:56.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80800K .......... .......... .......... .......... .......... 47% 24.5M 3s 2024-09-14T21:24:56.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80850K .......... .......... .......... .......... .......... 47% 49.8M 3s 2024-09-14T21:24:56.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80900K .......... .......... .......... .......... .......... 48% 35.8M 3s 2024-09-14T21:24:56.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 80950K .......... .......... .......... .......... .......... 48% 25.3M 3s 2024-09-14T21:24:56.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81000K .......... .......... .......... .......... .......... 48% 22.6M 3s 2024-09-14T21:24:56.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81050K .......... .......... .......... .......... .......... 48% 47.4M 3s 2024-09-14T21:24:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81100K .......... .......... .......... .......... .......... 48% 26.0M 3s 2024-09-14T21:24:56.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81150K .......... .......... .......... .......... .......... 48% 23.4M 3s 2024-09-14T21:24:56.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81200K .......... .......... .......... .......... .......... 48% 34.3M 3s 2024-09-14T21:24:56.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81250K .......... .......... .......... .......... .......... 48% 27.6M 3s 2024-09-14T21:24:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81300K .......... .......... .......... .......... .......... 48% 37.3M 3s 2024-09-14T21:24:56.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81350K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-09-14T21:24:56.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81400K .......... .......... .......... .......... .......... 48% 37.3M 3s 2024-09-14T21:24:56.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81450K .......... .......... .......... .......... .......... 48% 23.5M 3s 2024-09-14T21:24:56.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81500K .......... .......... .......... .......... .......... 48% 27.8M 3s 2024-09-14T21:24:56.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81550K .......... .......... .......... .......... .......... 48% 22.7M 3s 2024-09-14T21:24:56.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81600K .......... .......... .......... .......... .......... 48% 39.2M 3s 2024-09-14T21:24:56.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81650K .......... .......... .......... .......... .......... 48% 26.5M 3s 2024-09-14T21:24:56.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81700K .......... .......... .......... .......... .......... 48% 40.5M 3s 2024-09-14T21:24:56.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81750K .......... .......... .......... .......... .......... 48% 23.0M 3s 2024-09-14T21:24:56.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81800K .......... .......... .......... .......... .......... 48% 52.1M 3s 2024-09-14T21:24:56.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81850K .......... .......... .......... .......... .......... 48% 22.2M 3s 2024-09-14T21:24:56.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81900K .......... .......... .......... .......... .......... 48% 38.0M 3s 2024-09-14T21:24:56.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 81950K .......... .......... .......... .......... .......... 48% 26.0M 3s 2024-09-14T21:24:56.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82000K .......... .......... .......... .......... .......... 48% 25.5M 3s 2024-09-14T21:24:56.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82050K .......... .......... .......... .......... .......... 48% 23.5M 3s 2024-09-14T21:24:56.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82100K .......... .......... .......... .......... .......... 48% 55.1M 3s 2024-09-14T21:24:56.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82150K .......... .......... .......... .......... .......... 48% 20.6M 3s 2024-09-14T21:24:56.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82200K .......... .......... .......... .......... .......... 48% 37.0M 3s 2024-09-14T21:24:56.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82250K .......... .......... .......... .......... .......... 48% 28.0M 3s 2024-09-14T21:24:56.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82300K .......... .......... .......... .......... .......... 48% 38.8M 3s 2024-09-14T21:24:56.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82350K .......... .......... .......... .......... .......... 48% 26.9M 3s 2024-09-14T21:24:56.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82400K .......... .......... .......... .......... .......... 48% 25.5M 3s 2024-09-14T21:24:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82450K .......... .......... .......... .......... .......... 48% 31.8M 3s 2024-09-14T21:24:56.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82500K .......... .......... .......... .......... .......... 48% 22.2M 3s 2024-09-14T21:24:56.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82550K .......... .......... .......... .......... .......... 49% 26.6M 3s 2024-09-14T21:24:56.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82600K .......... .......... .......... .......... .......... 49% 56.3M 3s 2024-09-14T21:24:56.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82650K .......... .......... .......... .......... .......... 49% 24.8M 3s 2024-09-14T21:24:56.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82700K .......... .......... .......... .......... .......... 49% 34.7M 3s 2024-09-14T21:24:56.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82750K .......... .......... .......... .......... .......... 49% 24.9M 3s 2024-09-14T21:24:56.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82800K .......... .......... .......... .......... .......... 49% 22.8M 3s 2024-09-14T21:24:56.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82850K .......... .......... .......... .......... .......... 49% 42.6M 3s 2024-09-14T21:24:56.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82900K .......... .......... .......... .......... .......... 49% 28.8M 3s 2024-09-14T21:24:56.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 82950K .......... .......... .......... .......... .......... 49% 34.2M 3s 2024-09-14T21:24:56.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83000K .......... .......... .......... .......... .......... 49% 24.2M 3s 2024-09-14T21:24:56.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83050K .......... .......... .......... .......... .......... 49% 50.9M 3s 2024-09-14T21:24:56.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83100K .......... .......... .......... .......... .......... 49% 22.3M 3s 2024-09-14T21:24:56.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83150K .......... .......... .......... .......... .......... 49% 21.0M 3s 2024-09-14T21:24:56.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83200K .......... .......... .......... .......... .......... 49% 21.4M 3s 2024-09-14T21:24:56.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83250K .......... .......... .......... .......... .......... 49% 42.0M 3s 2024-09-14T21:24:56.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83300K .......... .......... .......... .......... .......... 49% 25.6M 3s 2024-09-14T21:24:56.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83350K .......... .......... .......... .......... .......... 49% 42.9M 3s 2024-09-14T21:24:56.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83400K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-09-14T21:24:56.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83450K .......... .......... .......... .......... .......... 49% 32.8M 3s 2024-09-14T21:24:56.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83500K .......... .......... .......... .......... .......... 49% 27.6M 3s 2024-09-14T21:24:56.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83550K .......... .......... .......... .......... .......... 49% 23.7M 3s 2024-09-14T21:24:56.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83600K .......... .......... .......... .......... .......... 49% 28.6M 3s 2024-09-14T21:24:56.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83650K .......... .......... .......... .......... .......... 49% 32.9M 3s 2024-09-14T21:24:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83700K .......... .......... .......... .......... .......... 49% 43.4M 3s 2024-09-14T21:24:56.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83750K .......... .......... .......... .......... .......... 49% 23.0M 3s 2024-09-14T21:24:56.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83800K .......... .......... .......... .......... .......... 49% 22.0M 3s 2024-09-14T21:24:56.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83850K .......... .......... .......... .......... .......... 49% 49.5M 3s 2024-09-14T21:24:56.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83900K .......... .......... .......... .......... .......... 49% 29.0M 3s 2024-09-14T21:24:56.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 83950K .......... .......... .......... .......... .......... 49% 27.0M 3s 2024-09-14T21:24:56.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84000K .......... .......... .......... .......... .......... 49% 32.7M 3s 2024-09-14T21:24:56.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84050K .......... .......... .......... .......... .......... 49% 28.1M 3s 2024-09-14T21:24:56.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84100K .......... .......... .......... .......... .......... 49% 34.7M 3s 2024-09-14T21:24:56.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84150K .......... .......... .......... .......... .......... 49% 25.0M 3s 2024-09-14T21:24:56.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84200K .......... .......... .......... .......... .......... 49% 36.4M 3s 2024-09-14T21:24:56.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84250K .......... .......... .......... .......... .......... 50% 24.4M 3s 2024-09-14T21:24:56.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84300K .......... .......... .......... .......... .......... 50% 22.3M 3s 2024-09-14T21:24:56.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84350K .......... .......... .......... .......... .......... 50% 23.1M 3s 2024-09-14T21:24:56.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84400K .......... .......... .......... .......... .......... 50% 43.9M 3s 2024-09-14T21:24:56.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84450K .......... .......... .......... .......... .......... 50% 26.1M 3s 2024-09-14T21:24:56.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84500K .......... .......... .......... .......... .......... 50% 33.5M 3s 2024-09-14T21:24:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84550K .......... .......... .......... .......... .......... 50% 27.1M 3s 2024-09-14T21:24:56.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84600K .......... .......... .......... .......... .......... 50% 49.2M 3s 2024-09-14T21:24:56.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84650K .......... .......... .......... .......... .......... 50% 20.6M 3s 2024-09-14T21:24:56.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84700K .......... .......... .......... .......... .......... 50% 57.5M 3s 2024-09-14T21:24:56.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84750K .......... .......... .......... .......... .......... 50% 19.5M 3s 2024-09-14T21:24:56.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84800K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-09-14T21:24:56.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84850K .......... .......... .......... .......... .......... 50% 26.9M 3s 2024-09-14T21:24:56.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84900K .......... .......... .......... .......... .......... 50% 44.3M 3s 2024-09-14T21:24:56.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 84950K .......... .......... .......... .......... .......... 50% 23.2M 3s 2024-09-14T21:24:56.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85000K .......... .......... .......... .......... .......... 50% 37.2M 3s 2024-09-14T21:24:56.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85050K .......... .......... .......... .......... .......... 50% 28.0M 3s 2024-09-14T21:24:56.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85100K .......... .......... .......... .......... .......... 50% 47.4M 3s 2024-09-14T21:24:56.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85150K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-09-14T21:24:56.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85200K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-09-14T21:24:56.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85250K .......... .......... .......... .......... .......... 50% 38.2M 3s 2024-09-14T21:24:56.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85300K .......... .......... .......... .......... .......... 50% 24.8M 3s 2024-09-14T21:24:56.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85350K .......... .......... .......... .......... .......... 50% 22.2M 3s 2024-09-14T21:24:56.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85400K .......... .......... .......... .......... .......... 50% 54.4M 3s 2024-09-14T21:24:56.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85450K .......... .......... .......... .......... .......... 50% 21.4M 3s 2024-09-14T21:24:56.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85500K .......... .......... .......... .......... .......... 50% 29.4M 3s 2024-09-14T21:24:56.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85550K .......... .......... .......... .......... .......... 50% 32.9M 3s 2024-09-14T21:24:56.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85600K .......... .......... .......... .......... .......... 50% 25.7M 3s 2024-09-14T21:24:56.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85650K .......... .......... .......... .......... .......... 50% 29.9M 3s 2024-09-14T21:24:56.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85700K .......... .......... .......... .......... .......... 50% 29.8M 3s 2024-09-14T21:24:56.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85750K .......... .......... .......... .......... .......... 50% 30.4M 3s 2024-09-14T21:24:56.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85800K .......... .......... .......... .......... .......... 50% 52.5M 3s 2024-09-14T21:24:56.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85850K .......... .......... .......... .......... .......... 50% 30.4M 3s 2024-09-14T21:24:56.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85900K .......... .......... .......... .......... .......... 50% 25.4M 3s 2024-09-14T21:24:56.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 85950K .......... .......... .......... .......... .......... 51% 23.6M 3s 2024-09-14T21:24:56.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86000K .......... .......... .......... .......... .......... 51% 35.1M 3s 2024-09-14T21:24:56.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86050K .......... .......... .......... .......... .......... 51% 22.0M 3s 2024-09-14T21:24:56.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86100K .......... .......... .......... .......... .......... 51% 26.6M 3s 2024-09-14T21:24:56.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86150K .......... .......... .......... .......... .......... 51% 46.7M 3s 2024-09-14T21:24:56.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86200K .......... .......... .......... .......... .......... 51% 33.9M 3s 2024-09-14T21:24:56.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86250K .......... .......... .......... .......... .......... 51% 26.8M 3s 2024-09-14T21:24:56.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86300K .......... .......... .......... .......... .......... 51% 24.3M 3s 2024-09-14T21:24:56.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86350K .......... .......... .......... .......... .......... 51% 22.1M 3s 2024-09-14T21:24:56.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86400K .......... .......... .......... .......... .......... 51% 63.2M 3s 2024-09-14T21:24:56.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86450K .......... .......... .......... .......... .......... 51% 23.2M 3s 2024-09-14T21:24:56.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86500K .......... .......... .......... .......... .......... 51% 32.1M 3s 2024-09-14T21:24:56.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86550K .......... .......... .......... .......... .......... 51% 21.3M 3s 2024-09-14T21:24:56.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86600K .......... .......... .......... .......... .......... 51% 23.2M 3s 2024-09-14T21:24:56.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86650K .......... .......... .......... .......... .......... 51% 49.1M 3s 2024-09-14T21:24:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86700K .......... .......... .......... .......... .......... 51% 24.2M 3s 2024-09-14T21:24:56.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86750K .......... .......... .......... .......... .......... 51% 22.7M 3s 2024-09-14T21:24:56.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86800K .......... .......... .......... .......... .......... 51% 27.3M 3s 2024-09-14T21:24:56.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86850K .......... .......... .......... .......... .......... 51% 24.3M 3s 2024-09-14T21:24:56.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86900K .......... .......... .......... .......... .......... 51% 148M 3s 2024-09-14T21:24:56.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 86950K .......... .......... .......... .......... .......... 51% 22.6M 3s 2024-09-14T21:24:56.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87000K .......... .......... .......... .......... .......... 51% 24.6M 3s 2024-09-14T21:24:56.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87050K .......... .......... .......... .......... .......... 51% 26.8M 3s 2024-09-14T21:24:56.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87100K .......... .......... .......... .......... .......... 51% 29.4M 3s 2024-09-14T21:24:56.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87150K .......... .......... .......... .......... .......... 51% 37.7M 3s 2024-09-14T21:24:56.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87200K .......... .......... .......... .......... .......... 51% 33.0M 3s 2024-09-14T21:24:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87250K .......... .......... .......... .......... .......... 51% 22.0M 3s 2024-09-14T21:24:56.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87300K .......... .......... .......... .......... .......... 51% 43.4M 3s 2024-09-14T21:24:56.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87350K .......... .......... .......... .......... .......... 51% 23.2M 3s 2024-09-14T21:24:56.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87400K .......... .......... .......... .......... .......... 51% 49.2M 3s 2024-09-14T21:24:56.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87450K .......... .......... .......... .......... .......... 51% 24.6M 3s 2024-09-14T21:24:56.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87500K .......... .......... .......... .......... .......... 51% 31.3M 3s 2024-09-14T21:24:56.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87550K .......... .......... .......... .......... .......... 51% 17.9M 3s 2024-09-14T21:24:56.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87600K .......... .......... .......... .......... .......... 51% 78.5M 3s 2024-09-14T21:24:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87650K .......... .......... .......... .......... .......... 52% 19.1M 3s 2024-09-14T21:24:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87700K .......... .......... .......... .......... .......... 52% 55.2M 3s 2024-09-14T21:24:56.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87750K .......... .......... .......... .......... .......... 52% 23.5M 3s 2024-09-14T21:24:56.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87800K .......... .......... .......... .......... .......... 52% 34.4M 3s 2024-09-14T21:24:56.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87850K .......... .......... .......... .......... .......... 52% 25.1M 3s 2024-09-14T21:24:56.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87900K .......... .......... .......... .......... .......... 52% 50.6M 3s 2024-09-14T21:24:56.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 87950K .......... .......... .......... .......... .......... 52% 23.9M 3s 2024-09-14T21:24:56.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88000K .......... .......... .......... .......... .......... 52% 24.3M 3s 2024-09-14T21:24:56.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88050K .......... .......... .......... .......... .......... 52% 33.5M 3s 2024-09-14T21:24:56.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88100K .......... .......... .......... .......... .......... 52% 27.3M 3s 2024-09-14T21:24:56.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88150K .......... .......... .......... .......... .......... 52% 32.4M 3s 2024-09-14T21:24:56.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88200K .......... .......... .......... .......... .......... 52% 14.4M 3s 2024-09-14T21:24:56.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88250K .......... .......... .......... .......... .......... 52% 176M 3s 2024-09-14T21:24:56.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88300K .......... .......... .......... .......... .......... 52% 46.1M 3s 2024-09-14T21:24:56.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88350K .......... .......... .......... .......... .......... 52% 21.9M 3s 2024-09-14T21:24:56.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88400K .......... .......... .......... .......... .......... 52% 23.0M 3s 2024-09-14T21:24:56.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88450K .......... .......... .......... .......... .......... 52% 43.1M 3s 2024-09-14T21:24:56.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88500K .......... .......... .......... .......... .......... 52% 26.8M 3s 2024-09-14T21:24:56.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88550K .......... .......... .......... .......... .......... 52% 37.4M 3s 2024-09-14T21:24:56.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88600K .......... .......... .......... .......... .......... 52% 25.3M 3s 2024-09-14T21:24:56.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88650K .......... .......... .......... .......... .......... 52% 35.7M 3s 2024-09-14T21:24:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88700K .......... .......... .......... .......... .......... 52% 26.3M 3s 2024-09-14T21:24:56.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88750K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-09-14T21:24:56.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88800K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-09-14T21:24:56.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88850K .......... .......... .......... .......... .......... 52% 39.3M 3s 2024-09-14T21:24:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88900K .......... .......... .......... .......... .......... 52% 22.8M 3s 2024-09-14T21:24:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 88950K .......... .......... .......... .......... .......... 52% 50.3M 3s 2024-09-14T21:24:56.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89000K .......... .......... .......... .......... .......... 52% 22.6M 3s 2024-09-14T21:24:56.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89050K .......... .......... .......... .......... .......... 52% 45.8M 3s 2024-09-14T21:24:56.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89100K .......... .......... .......... .......... .......... 52% 22.5M 3s 2024-09-14T21:24:56.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89150K .......... .......... .......... .......... .......... 52% 27.1M 3s 2024-09-14T21:24:56.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89200K .......... .......... .......... .......... .......... 52% 55.4M 3s 2024-09-14T21:24:56.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89250K .......... .......... .......... .......... .......... 52% 21.8M 3s 2024-09-14T21:24:56.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89300K .......... .......... .......... .......... .......... 53% 25.8M 3s 2024-09-14T21:24:56.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89350K .......... .......... .......... .......... .......... 53% 33.7M 3s 2024-09-14T21:24:56.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89400K .......... .......... .......... .......... .......... 53% 23.0M 3s 2024-09-14T21:24:56.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89450K .......... .......... .......... .......... .......... 53% 38.9M 3s 2024-09-14T21:24:56.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89500K .......... .......... .......... .......... .......... 53% 29.2M 3s 2024-09-14T21:24:56.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89550K .......... .......... .......... .......... .......... 53% 24.5M 3s 2024-09-14T21:24:56.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89600K .......... .......... .......... .......... .......... 53% 37.3M 3s 2024-09-14T21:24:56.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89650K .......... .......... .......... .......... .......... 53% 24.7M 3s 2024-09-14T21:24:56.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89700K .......... .......... .......... .......... .......... 53% 45.4M 3s 2024-09-14T21:24:56.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89750K .......... .......... .......... .......... .......... 53% 23.4M 3s 2024-09-14T21:24:56.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89800K .......... .......... .......... .......... .......... 53% 33.5M 3s 2024-09-14T21:24:56.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89850K .......... .......... .......... .......... .......... 53% 29.3M 3s 2024-09-14T21:24:56.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89900K .......... .......... .......... .......... .......... 53% 21.2M 3s 2024-09-14T21:24:56.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 89950K .......... .......... .......... .......... .......... 53% 25.3M 3s 2024-09-14T21:24:56.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90000K .......... .......... .......... .......... .......... 53% 57.1M 3s 2024-09-14T21:24:56.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90050K .......... .......... .......... .......... .......... 53% 13.9M 3s 2024-09-14T21:24:56.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90100K .......... .......... .......... .......... .......... 53% 31.5M 3s 2024-09-14T21:24:56.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90150K .......... .......... .......... .......... .......... 53% 24.1M 3s 2024-09-14T21:24:56.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90200K .......... .......... .......... .......... .......... 53% 72.3M 3s 2024-09-14T21:24:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90250K .......... .......... .......... .......... .......... 53% 23.8M 3s 2024-09-14T21:24:56.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90300K .......... .......... .......... .......... .......... 53% 33.6M 3s 2024-09-14T21:24:56.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90350K .......... .......... .......... .......... .......... 53% 24.9M 3s 2024-09-14T21:24:56.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90400K .......... .......... .......... .......... .......... 53% 23.8M 3s 2024-09-14T21:24:56.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90450K .......... .......... .......... .......... .......... 53% 36.8M 3s 2024-09-14T21:24:56.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90500K .......... .......... .......... .......... .......... 53% 33.3M 3s 2024-09-14T21:24:56.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90550K .......... .......... .......... .......... .......... 53% 20.0M 3s 2024-09-14T21:24:56.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90600K .......... .......... .......... .......... .......... 53% 40.7M 3s 2024-09-14T21:24:56.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90650K .......... .......... .......... .......... .......... 53% 21.3M 3s 2024-09-14T21:24:56.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90700K .......... .......... .......... .......... .......... 53% 89.7M 3s 2024-09-14T21:24:56.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90750K .......... .......... .......... .......... .......... 53% 23.1M 3s 2024-09-14T21:24:56.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90800K .......... .......... .......... .......... .......... 53% 23.4M 3s 2024-09-14T21:24:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90850K .......... .......... .......... .......... .......... 53% 35.9M 3s 2024-09-14T21:24:56.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90900K .......... .......... .......... .......... .......... 53% 25.1M 3s 2024-09-14T21:24:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 90950K .......... .......... .......... .......... .......... 53% 49.5M 3s 2024-09-14T21:24:56.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91000K .......... .......... .......... .......... .......... 54% 27.6M 3s 2024-09-14T21:24:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91050K .......... .......... .......... .......... .......... 54% 29.5M 3s 2024-09-14T21:24:56.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91100K .......... .......... .......... .......... .......... 54% 22.7M 3s 2024-09-14T21:24:56.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91150K .......... .......... .......... .......... .......... 54% 23.3M 3s 2024-09-14T21:24:56.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91200K .......... .......... .......... .......... .......... 54% 27.5M 3s 2024-09-14T21:24:56.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91250K .......... .......... .......... .......... .......... 54% 47.3M 3s 2024-09-14T21:24:56.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91300K .......... .......... .......... .......... .......... 54% 24.8M 3s 2024-09-14T21:24:56.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91350K .......... .......... .......... .......... .......... 54% 39.6M 3s 2024-09-14T21:24:56.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91400K .......... .......... .......... .......... .......... 54% 21.1M 3s 2024-09-14T21:24:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91450K .......... .......... .......... .......... .......... 54% 63.8M 3s 2024-09-14T21:24:56.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91500K .......... .......... .......... .......... .......... 54% 30.2M 3s 2024-09-14T21:24:56.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91550K .......... .......... .......... .......... .......... 54% 20.5M 3s 2024-09-14T21:24:56.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91600K .......... .......... .......... .......... .......... 54% 35.0M 3s 2024-09-14T21:24:56.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91650K .......... .......... .......... .......... .......... 54% 23.6M 3s 2024-09-14T21:24:56.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91700K .......... .......... .......... .......... .......... 54% 23.3M 3s 2024-09-14T21:24:56.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91750K .......... .......... .......... .......... .......... 54% 47.3M 3s 2024-09-14T21:24:56.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91800K .......... .......... .......... .......... .......... 54% 26.6M 3s 2024-09-14T21:24:56.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91850K .......... .......... .......... .......... .......... 54% 38.6M 3s 2024-09-14T21:24:56.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91900K .......... .......... .......... .......... .......... 54% 21.7M 3s 2024-09-14T21:24:56.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 91950K .......... .......... .......... .......... .......... 54% 25.0M 3s 2024-09-14T21:24:56.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92000K .......... .......... .......... .......... .......... 54% 47.4M 3s 2024-09-14T21:24:56.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92050K .......... .......... .......... .......... .......... 54% 24.4M 3s 2024-09-14T21:24:56.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92100K .......... .......... .......... .......... .......... 54% 42.6M 3s 2024-09-14T21:24:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92150K .......... .......... .......... .......... .......... 54% 19.5M 3s 2024-09-14T21:24:56.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92200K .......... .......... .......... .......... .......... 54% 28.5M 3s 2024-09-14T21:24:56.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92250K .......... .......... .......... .......... .......... 54% 41.9M 3s 2024-09-14T21:24:56.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92300K .......... .......... .......... .......... .......... 54% 24.3M 3s 2024-09-14T21:24:56.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92350K .......... .......... .......... .......... .......... 54% 23.4M 3s 2024-09-14T21:24:56.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92400K .......... .......... .......... .......... .......... 54% 41.6M 3s 2024-09-14T21:24:56.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92450K .......... .......... .......... .......... .......... 54% 27.2M 3s 2024-09-14T21:24:56.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92500K .......... .......... .......... .......... .......... 54% 37.9M 3s 2024-09-14T21:24:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92550K .......... .......... .......... .......... .......... 54% 24.2M 3s 2024-09-14T21:24:56.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92600K .......... .......... .......... .......... .......... 54% 33.8M 3s 2024-09-14T21:24:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92650K .......... .......... .......... .......... .......... 54% 26.3M 3s 2024-09-14T21:24:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92700K .......... .......... .......... .......... .......... 55% 24.3M 3s 2024-09-14T21:24:56.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92750K .......... .......... .......... .......... .......... 55% 24.5M 3s 2024-09-14T21:24:56.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92800K .......... .......... .......... .......... .......... 55% 51.4M 3s 2024-09-14T21:24:56.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92850K .......... .......... .......... .......... .......... 55% 24.1M 3s 2024-09-14T21:24:56.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92900K .......... .......... .......... .......... .......... 55% 42.9M 3s 2024-09-14T21:24:56.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 92950K .......... .......... .......... .......... .......... 55% 23.6M 3s 2024-09-14T21:24:56.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93000K .......... .......... .......... .......... .......... 55% 45.1M 3s 2024-09-14T21:24:56.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93050K .......... .......... .......... .......... .......... 55% 25.5M 3s 2024-09-14T21:24:56.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93100K .......... .......... .......... .......... .......... 55% 34.5M 3s 2024-09-14T21:24:56.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93150K .......... .......... .......... .......... .......... 55% 25.6M 3s 2024-09-14T21:24:56.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93200K .......... .......... .......... .......... .......... 55% 23.8M 3s 2024-09-14T21:24:56.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93250K .......... .......... .......... .......... .......... 55% 23.4M 3s 2024-09-14T21:24:56.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93300K .......... .......... .......... .......... .......... 55% 58.9M 3s 2024-09-14T21:24:56.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93350K .......... .......... .......... .......... .......... 55% 21.0M 3s 2024-09-14T21:24:56.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93400K .......... .......... .......... .......... .......... 55% 39.2M 3s 2024-09-14T21:24:56.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93450K .......... .......... .......... .......... .......... 55% 21.4M 3s 2024-09-14T21:24:56.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93500K .......... .......... .......... .......... .......... 55% 69.9M 3s 2024-09-14T21:24:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93550K .......... .......... .......... .......... .......... 55% 20.3M 3s 2024-09-14T21:24:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93600K .......... .......... .......... .......... .......... 55% 28.9M 3s 2024-09-14T21:24:56.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93650K .......... .......... .......... .......... .......... 55% 33.3M 3s 2024-09-14T21:24:56.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93700K .......... .......... .......... .......... .......... 55% 22.4M 3s 2024-09-14T21:24:56.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93750K .......... .......... .......... .......... .......... 55% 53.7M 3s 2024-09-14T21:24:56.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93800K .......... .......... .......... .......... .......... 55% 27.5M 3s 2024-09-14T21:24:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93850K .......... .......... .......... .......... .......... 55% 30.2M 3s 2024-09-14T21:24:56.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93900K .......... .......... .......... .......... .......... 55% 23.1M 3s 2024-09-14T21:24:56.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 93950K .......... .......... .......... .......... .......... 55% 22.8M 3s 2024-09-14T21:24:56.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94000K .......... .......... .......... .......... .......... 55% 33.2M 3s 2024-09-14T21:24:56.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94050K .......... .......... .......... .......... .......... 55% 41.6M 3s 2024-09-14T21:24:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94100K .......... .......... .......... .......... .......... 55% 22.1M 3s 2024-09-14T21:24:56.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94150K .......... .......... .......... .......... .......... 55% 28.5M 3s 2024-09-14T21:24:56.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94200K .......... .......... .......... .......... .......... 55% 28.6M 3s 2024-09-14T21:24:56.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94250K .......... .......... .......... .......... .......... 55% 58.5M 3s 2024-09-14T21:24:56.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94300K .......... .......... .......... .......... .......... 55% 24.6M 3s 2024-09-14T21:24:56.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94350K .......... .......... .......... .......... .......... 56% 22.9M 3s 2024-09-14T21:24:56.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94400K .......... .......... .......... .......... .......... 56% 37.9M 3s 2024-09-14T21:24:56.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94450K .......... .......... .......... .......... .......... 56% 23.7M 3s 2024-09-14T21:24:56.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94500K .......... .......... .......... .......... .......... 56% 41.9M 3s 2024-09-14T21:24:56.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94550K .......... .......... .......... .......... .......... 56% 28.2M 3s 2024-09-14T21:24:56.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94600K .......... .......... .......... .......... .......... 56% 22.4M 3s 2024-09-14T21:24:56.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94650K .......... .......... .......... .......... .......... 56% 41.3M 3s 2024-09-14T21:24:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94700K .......... .......... .......... .......... .......... 56% 33.0M 3s 2024-09-14T21:24:56.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94750K .......... .......... .......... .......... .......... 56% 18.5M 3s 2024-09-14T21:24:56.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94800K .......... .......... .......... .......... .......... 56% 51.2M 3s 2024-09-14T21:24:56.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94850K .......... .......... .......... .......... .......... 56% 26.4M 3s 2024-09-14T21:24:56.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94900K .......... .......... .......... .......... .......... 56% 36.0M 3s 2024-09-14T21:24:56.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 94950K .......... .......... .......... .......... .......... 56% 22.7M 3s 2024-09-14T21:24:56.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95000K .......... .......... .......... .......... .......... 56% 21.6M 3s 2024-09-14T21:24:56.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95050K .......... .......... .......... .......... .......... 56% 128M 3s 2024-09-14T21:24:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95100K .......... .......... .......... .......... .......... 56% 19.3M 3s 2024-09-14T21:24:56.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95150K .......... .......... .......... .......... .......... 56% 24.7M 3s 2024-09-14T21:24:56.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95200K .......... .......... .......... .......... .......... 56% 37.7M 3s 2024-09-14T21:24:56.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95250K .......... .......... .......... .......... .......... 56% 33.9M 3s 2024-09-14T21:24:56.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95300K .......... .......... .......... .......... .......... 56% 32.8M 3s 2024-09-14T21:24:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95350K .......... .......... .......... .......... .......... 56% 25.5M 3s 2024-09-14T21:24:56.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95400K .......... .......... .......... .......... .......... 56% 30.5M 3s 2024-09-14T21:24:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95450K .......... .......... .......... .......... .......... 56% 24.0M 3s 2024-09-14T21:24:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95500K .......... .......... .......... .......... .......... 56% 61.4M 3s 2024-09-14T21:24:56.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95550K .......... .......... .......... .......... .......... 56% 19.5M 3s 2024-09-14T21:24:56.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95600K .......... .......... .......... .......... .......... 56% 41.6M 3s 2024-09-14T21:24:56.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95650K .......... .......... .......... .......... .......... 56% 26.2M 3s 2024-09-14T21:24:56.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95700K .......... .......... .......... .......... .......... 56% 28.0M 3s 2024-09-14T21:24:56.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95750K .......... .......... .......... .......... .......... 56% 21.6M 3s 2024-09-14T21:24:56.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95800K .......... .......... .......... .......... .......... 56% 58.9M 3s 2024-09-14T21:24:56.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95850K .......... .......... .......... .......... .......... 56% 23.7M 3s 2024-09-14T21:24:56.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95900K .......... .......... .......... .......... .......... 56% 39.3M 3s 2024-09-14T21:24:56.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 95950K .......... .......... .......... .......... .......... 56% 21.5M 2s 2024-09-14T21:24:56.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96000K .......... .......... .......... .......... .......... 56% 27.3M 2s 2024-09-14T21:24:56.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96050K .......... .......... .......... .......... .......... 57% 45.7M 2s 2024-09-14T21:24:56.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96100K .......... .......... .......... .......... .......... 57% 24.6M 2s 2024-09-14T21:24:56.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96150K .......... .......... .......... .......... .......... 57% 33.8M 2s 2024-09-14T21:24:56.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96200K .......... .......... .......... .......... .......... 57% 20.1M 2s 2024-09-14T21:24:56.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96250K .......... .......... .......... .......... .......... 57% 30.5M 2s 2024-09-14T21:24:56.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96300K .......... .......... .......... .......... .......... 57% 56.3M 2s 2024-09-14T21:24:56.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96350K .......... .......... .......... .......... .......... 57% 23.3M 2s 2024-09-14T21:24:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96400K .......... .......... .......... .......... .......... 57% 24.8M 2s 2024-09-14T21:24:56.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96450K .......... .......... .......... .......... .......... 57% 34.1M 2s 2024-09-14T21:24:56.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96500K .......... .......... .......... .......... .......... 57% 30.5M 2s 2024-09-14T21:24:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96550K .......... .......... .......... .......... .......... 57% 40.6M 2s 2024-09-14T21:24:56.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96600K .......... .......... .......... .......... .......... 57% 23.9M 2s 2024-09-14T21:24:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96650K .......... .......... .......... .......... .......... 57% 40.5M 2s 2024-09-14T21:24:56.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96700K .......... .......... .......... .......... .......... 57% 22.1M 2s 2024-09-14T21:24:56.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96750K .......... .......... .......... .......... .......... 57% 29.6M 2s 2024-09-14T21:24:56.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96800K .......... .......... .......... .......... .......... 57% 21.4M 2s 2024-09-14T21:24:56.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96850K .......... .......... .......... .......... .......... 57% 45.8M 2s 2024-09-14T21:24:56.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96900K .......... .......... .......... .......... .......... 57% 24.8M 2s 2024-09-14T21:24:56.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 96950K .......... .......... .......... .......... .......... 57% 36.3M 2s 2024-09-14T21:24:56.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97000K .......... .......... .......... .......... .......... 57% 24.4M 2s 2024-09-14T21:24:56.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97050K .......... .......... .......... .......... .......... 57% 45.9M 2s 2024-09-14T21:24:56.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97100K .......... .......... .......... .......... .......... 57% 23.8M 2s 2024-09-14T21:24:56.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97150K .......... .......... .......... .......... .......... 57% 31.5M 2s 2024-09-14T21:24:56.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97200K .......... .......... .......... .......... .......... 57% 25.5M 2s 2024-09-14T21:24:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97250K .......... .......... .......... .......... .......... 57% 23.8M 2s 2024-09-14T21:24:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97300K .......... .......... .......... .......... .......... 57% 25.4M 2s 2024-09-14T21:24:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97350K .......... .......... .......... .......... .......... 57% 65.4M 2s 2024-09-14T21:24:56.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97400K .......... .......... .......... .......... .......... 57% 21.3M 2s 2024-09-14T21:24:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97450K .......... .......... .......... .......... .......... 57% 44.0M 2s 2024-09-14T21:24:56.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97500K .......... .......... .......... .......... .......... 57% 24.0M 2s 2024-09-14T21:24:56.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97550K .......... .......... .......... .......... .......... 57% 26.0M 2s 2024-09-14T21:24:56.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97600K .......... .......... .......... .......... .......... 57% 40.7M 2s 2024-09-14T21:24:56.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97650K .......... .......... .......... .......... .......... 57% 23.5M 2s 2024-09-14T21:24:56.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97700K .......... .......... .......... .......... .......... 57% 34.9M 2s 2024-09-14T21:24:56.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97750K .......... .......... .......... .......... .......... 58% 23.5M 2s 2024-09-14T21:24:56.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97800K .......... .......... .......... .......... .......... 58% 25.6M 2s 2024-09-14T21:24:56.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97850K .......... .......... .......... .......... .......... 58% 54.9M 2s 2024-09-14T21:24:56.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97900K .......... .......... .......... .......... .......... 58% 35.6M 2s 2024-09-14T21:24:56.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 97950K .......... .......... .......... .......... .......... 58% 17.4M 2s 2024-09-14T21:24:56.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98000K .......... .......... .......... .......... .......... 58% 41.4M 2s 2024-09-14T21:24:56.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98050K .......... .......... .......... .......... .......... 58% 23.7M 2s 2024-09-14T21:24:56.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98100K .......... .......... .......... .......... .......... 58% 52.3M 2s 2024-09-14T21:24:56.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98150K .......... .......... .......... .......... .......... 58% 21.4M 2s 2024-09-14T21:24:56.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98200K .......... .......... .......... .......... .......... 58% 48.6M 2s 2024-09-14T21:24:56.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98250K .......... .......... .......... .......... .......... 58% 19.8M 2s 2024-09-14T21:24:56.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98300K .......... .......... .......... .......... .......... 58% 43.1M 2s 2024-09-14T21:24:56.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98350K .......... .......... .......... .......... .......... 58% 18.8M 2s 2024-09-14T21:24:56.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98400K .......... .......... .......... .......... .......... 58% 45.8M 2s 2024-09-14T21:24:56.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98450K .......... .......... .......... .......... .......... 58% 41.9M 2s 2024-09-14T21:24:56.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98500K .......... .......... .......... .......... .......... 58% 23.2M 2s 2024-09-14T21:24:56.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98550K .......... .......... .......... .......... .......... 58% 23.0M 2s 2024-09-14T21:24:56.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98600K .......... .......... .......... .......... .......... 58% 71.2M 2s 2024-09-14T21:24:56.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98650K .......... .......... .......... .......... .......... 58% 24.2M 2s 2024-09-14T21:24:56.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98700K .......... .......... .......... .......... .......... 58% 28.4M 2s 2024-09-14T21:24:56.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98750K .......... .......... .......... .......... .......... 58% 22.6M 2s 2024-09-14T21:24:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98800K .......... .......... .......... .......... .......... 58% 32.2M 2s 2024-09-14T21:24:56.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98850K .......... .......... .......... .......... .......... 58% 40.1M 2s 2024-09-14T21:24:56.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98900K .......... .......... .......... .......... .......... 58% 27.5M 2s 2024-09-14T21:24:56.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 98950K .......... .......... .......... .......... .......... 58% 32.6M 2s 2024-09-14T21:24:56.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99000K .......... .......... .......... .......... .......... 58% 24.1M 2s 2024-09-14T21:24:56.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99050K .......... .......... .......... .......... .......... 58% 23.5M 2s 2024-09-14T21:24:56.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99100K .......... .......... .......... .......... .......... 58% 63.3M 2s 2024-09-14T21:24:56.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99150K .......... .......... .......... .......... .......... 58% 23.4M 2s 2024-09-14T21:24:56.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99200K .......... .......... .......... .......... .......... 58% 24.0M 2s 2024-09-14T21:24:56.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99250K .......... .......... .......... .......... .......... 58% 26.5M 2s 2024-09-14T21:24:56.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99300K .......... .......... .......... .......... .......... 58% 33.7M 2s 2024-09-14T21:24:56.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99350K .......... .......... .......... .......... .......... 58% 49.7M 2s 2024-09-14T21:24:56.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99400K .......... .......... .......... .......... .......... 58% 19.7M 2s 2024-09-14T21:24:56.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99450K .......... .......... .......... .......... .......... 59% 56.7M 2s 2024-09-14T21:24:56.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99500K .......... .......... .......... .......... .......... 59% 23.9M 2s 2024-09-14T21:24:56.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99550K .......... .......... .......... .......... .......... 59% 21.1M 2s 2024-09-14T21:24:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99600K .......... .......... .......... .......... .......... 59% 26.9M 2s 2024-09-14T21:24:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99650K .......... .......... .......... .......... .......... 59% 53.4M 2s 2024-09-14T21:24:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99700K .......... .......... .......... .......... .......... 59% 25.9M 2s 2024-09-14T21:24:56.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99750K .......... .......... .......... .......... .......... 59% 34.3M 2s 2024-09-14T21:24:56.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99800K .......... .......... .......... .......... .......... 59% 21.0M 2s 2024-09-14T21:24:56.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99850K .......... .......... .......... .......... .......... 59% 72.3M 2s 2024-09-14T21:24:56.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99900K .......... .......... .......... .......... .......... 59% 24.8M 2s 2024-09-14T21:24:56.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 99950K .......... .......... .......... .......... .......... 59% 22.4M 2s 2024-09-14T21:24:56.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100000K .......... .......... .......... .......... .......... 59% 40.5M 2s 2024-09-14T21:24:56.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100050K .......... .......... .......... .......... .......... 59% 22.5M 2s 2024-09-14T21:24:56.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100100K .......... .......... .......... .......... .......... 59% 25.4M 2s 2024-09-14T21:24:56.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100150K .......... .......... .......... .......... .......... 59% 38.9M 2s 2024-09-14T21:24:56.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100200K .......... .......... .......... .......... .......... 59% 26.2M 2s 2024-09-14T21:24:56.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100250K .......... .......... .......... .......... .......... 59% 36.2M 2s 2024-09-14T21:24:56.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100300K .......... .......... .......... .......... .......... 59% 26.0M 2s 2024-09-14T21:24:56.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100350K .......... .......... .......... .......... .......... 59% 23.5M 2s 2024-09-14T21:24:56.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100400K .......... .......... .......... .......... .......... 59% 50.4M 2s 2024-09-14T21:24:56.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100450K .......... .......... .......... .......... .......... 59% 23.2M 2s 2024-09-14T21:24:56.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100500K .......... .......... .......... .......... .......... 59% 43.9M 2s 2024-09-14T21:24:56.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100550K .......... .......... .......... .......... .......... 59% 23.3M 2s 2024-09-14T21:24:56.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100600K .......... .......... .......... .......... .......... 59% 39.5M 2s 2024-09-14T21:24:56.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100650K .......... .......... .......... .......... .......... 59% 26.1M 2s 2024-09-14T21:24:56.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100700K .......... .......... .......... .......... .......... 59% 35.3M 2s 2024-09-14T21:24:56.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100750K .......... .......... .......... .......... .......... 59% 18.4M 2s 2024-09-14T21:24:56.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100800K .......... .......... .......... .......... .......... 59% 40.6M 2s 2024-09-14T21:24:56.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100850K .......... .......... .......... .......... .......... 59% 23.9M 2s 2024-09-14T21:24:56.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100900K .......... .......... .......... .......... .......... 59% 45.8M 2s 2024-09-14T21:24:56.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:100950K .......... .......... .......... .......... .......... 59% 29.2M 2s 2024-09-14T21:24:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101000K .......... .......... .......... .......... .......... 59% 24.2M 2s 2024-09-14T21:24:56.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101050K .......... .......... .......... .......... .......... 59% 24.0M 2s 2024-09-14T21:24:56.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101100K .......... .......... .......... .......... .......... 60% 43.5M 2s 2024-09-14T21:24:56.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101150K .......... .......... .......... .......... .......... 60% 23.1M 2s 2024-09-14T21:24:56.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101200K .......... .......... .......... .......... .......... 60% 28.0M 2s 2024-09-14T21:24:56.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101250K .......... .......... .......... .......... .......... 60% 35.4M 2s 2024-09-14T21:24:56.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101300K .......... .......... .......... .......... .......... 60% 22.8M 2s 2024-09-14T21:24:56.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101350K .......... .......... .......... .......... .......... 60% 22.9M 2s 2024-09-14T21:24:56.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101400K .......... .......... .......... .......... .......... 60% 55.8M 2s 2024-09-14T21:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101450K .......... .......... .......... .......... .......... 60% 24.6M 2s 2024-09-14T21:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101500K .......... .......... .......... .......... .......... 60% 30.8M 2s 2024-09-14T21:24:56.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101550K .......... .......... .......... .......... .......... 60% 29.0M 2s 2024-09-14T21:24:56.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101600K .......... .......... .......... .......... .......... 60% 24.9M 2s 2024-09-14T21:24:56.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101650K .......... .......... .......... .......... .......... 60% 42.2M 2s 2024-09-14T21:24:56.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101700K .......... .......... .......... .......... .......... 60% 26.6M 2s 2024-09-14T21:24:56.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101750K .......... .......... .......... .......... .......... 60% 27.4M 2s 2024-09-14T21:24:56.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101800K .......... .......... .......... .......... .......... 60% 27.5M 2s 2024-09-14T21:24:56.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101850K .......... .......... .......... .......... .......... 60% 23.7M 2s 2024-09-14T21:24:56.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101900K .......... .......... .......... .......... .......... 60% 65.4M 2s 2024-09-14T21:24:56.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:101950K .......... .......... .......... .......... .......... 60% 22.2M 2s 2024-09-14T21:24:56.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102000K .......... .......... .......... .......... .......... 60% 25.8M 2s 2024-09-14T21:24:56.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102050K .......... .......... .......... .......... .......... 60% 36.9M 2s 2024-09-14T21:24:56.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102100K .......... .......... .......... .......... .......... 60% 23.0M 2s 2024-09-14T21:24:56.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102150K .......... .......... .......... .......... .......... 60% 41.6M 2s 2024-09-14T21:24:56.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102200K .......... .......... .......... .......... .......... 60% 27.3M 2s 2024-09-14T21:24:56.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102250K .......... .......... .......... .......... .......... 60% 37.4M 2s 2024-09-14T21:24:56.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102300K .......... .......... .......... .......... .......... 60% 25.3M 2s 2024-09-14T21:24:56.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102350K .......... .......... .......... .......... .......... 60% 19.9M 2s 2024-09-14T21:24:56.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102400K .......... .......... .......... .......... .......... 60% 32.0M 2s 2024-09-14T21:24:56.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102450K .......... .......... .......... .......... .......... 60% 32.7M 2s 2024-09-14T21:24:56.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102500K .......... .......... .......... .......... .......... 60% 28.1M 2s 2024-09-14T21:24:56.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102550K .......... .......... .......... .......... .......... 60% 27.1M 2s 2024-09-14T21:24:56.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102600K .......... .......... .......... .......... .......... 60% 23.4M 2s 2024-09-14T21:24:56.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102650K .......... .......... .......... .......... .......... 60% 147M 2s 2024-09-14T21:24:56.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102700K .......... .......... .......... .......... .......... 60% 21.2M 2s 2024-09-14T21:24:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102750K .......... .......... .......... .......... .......... 60% 26.6M 2s 2024-09-14T21:24:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102800K .......... .......... .......... .......... .......... 61% 29.4M 2s 2024-09-14T21:24:56.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102850K .......... .......... .......... .......... .......... 61% 27.5M 2s 2024-09-14T21:24:56.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102900K .......... .......... .......... .......... .......... 61% 28.1M 2s 2024-09-14T21:24:56.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:102950K .......... .......... .......... .......... .......... 61% 37.4M 2s 2024-09-14T21:24:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103000K .......... .......... .......... .......... .......... 61% 35.7M 2s 2024-09-14T21:24:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103050K .......... .......... .......... .......... .......... 61% 22.6M 2s 2024-09-14T21:24:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103100K .......... .......... .......... .......... .......... 61% 25.7M 2s 2024-09-14T21:24:56.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103150K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-09-14T21:24:56.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103200K .......... .......... .......... .......... .......... 61% 55.2M 2s 2024-09-14T21:24:56.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103250K .......... .......... .......... .......... .......... 61% 32.1M 2s 2024-09-14T21:24:56.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103300K .......... .......... .......... .......... .......... 61% 26.8M 2s 2024-09-14T21:24:56.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103350K .......... .......... .......... .......... .......... 61% 24.0M 2s 2024-09-14T21:24:56.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103400K .......... .......... .......... .......... .......... 61% 49.7M 2s 2024-09-14T21:24:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103450K .......... .......... .......... .......... .......... 61% 26.1M 2s 2024-09-14T21:24:56.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103500K .......... .......... .......... .......... .......... 61% 33.9M 2s 2024-09-14T21:24:56.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103550K .......... .......... .......... .......... .......... 61% 22.8M 2s 2024-09-14T21:24:56.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103600K .......... .......... .......... .......... .......... 61% 25.1M 2s 2024-09-14T21:24:56.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103650K .......... .......... .......... .......... .......... 61% 24.6M 2s 2024-09-14T21:24:56.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103700K .......... .......... .......... .......... .......... 61% 48.7M 2s 2024-09-14T21:24:56.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103750K .......... .......... .......... .......... .......... 61% 22.5M 2s 2024-09-14T21:24:56.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103800K .......... .......... .......... .......... .......... 61% 43.1M 2s 2024-09-14T21:24:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103850K .......... .......... .......... .......... .......... 61% 24.8M 2s 2024-09-14T21:24:56.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103900K .......... .......... .......... .......... .......... 61% 47.3M 2s 2024-09-14T21:24:56.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:103950K .......... .......... .......... .......... .......... 61% 21.4M 2s 2024-09-14T21:24:56.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104000K .......... .......... .......... .......... .......... 61% 28.7M 2s 2024-09-14T21:24:56.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104050K .......... .......... .......... .......... .......... 61% 33.6M 2s 2024-09-14T21:24:56.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104100K .......... .......... .......... .......... .......... 61% 25.0M 2s 2024-09-14T21:24:56.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104150K .......... .......... .......... .......... .......... 61% 23.4M 2s 2024-09-14T21:24:56.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104200K .......... .......... .......... .......... .......... 61% 44.6M 2s 2024-09-14T21:24:56.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104250K .......... .......... .......... .......... .......... 61% 25.0M 2s 2024-09-14T21:24:56.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104300K .......... .......... .......... .......... .......... 61% 45.1M 2s 2024-09-14T21:24:56.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104350K .......... .......... .......... .......... .......... 61% 21.8M 2s 2024-09-14T21:24:56.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104400K .......... .......... .......... .......... .......... 61% 26.0M 2s 2024-09-14T21:24:56.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104450K .......... .......... .......... .......... .......... 61% 37.8M 2s 2024-09-14T21:24:56.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104500K .......... .......... .......... .......... .......... 62% 26.8M 2s 2024-09-14T21:24:56.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104550K .......... .......... .......... .......... .......... 62% 28.6M 2s 2024-09-14T21:24:56.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104600K .......... .......... .......... .......... .......... 62% 21.2M 2s 2024-09-14T21:24:56.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104650K .......... .......... .......... .......... .......... 62% 28.0M 2s 2024-09-14T21:24:56.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104700K .......... .......... .......... .......... .......... 62% 39.2M 2s 2024-09-14T21:24:56.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104750K .......... .......... .......... .......... .......... 62% 21.0M 2s 2024-09-14T21:24:56.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104800K .......... .......... .......... .......... .......... 62% 28.9M 2s 2024-09-14T21:24:56.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104850K .......... .......... .......... .......... .......... 62% 38.7M 2s 2024-09-14T21:24:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104900K .......... .......... .......... .......... .......... 62% 23.9M 2s 2024-09-14T21:24:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:104950K .......... .......... .......... .......... .......... 62% 47.2M 2s 2024-09-14T21:24:56.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105000K .......... .......... .......... .......... .......... 62% 22.2M 2s 2024-09-14T21:24:56.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105050K .......... .......... .......... .......... .......... 62% 45.2M 2s 2024-09-14T21:24:56.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105100K .......... .......... .......... .......... .......... 62% 19.2M 2s 2024-09-14T21:24:56.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105150K .......... .......... .......... .......... .......... 62% 26.5M 2s 2024-09-14T21:24:56.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105200K .......... .......... .......... .......... .......... 62% 21.5M 2s 2024-09-14T21:24:56.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105250K .......... .......... .......... .......... .......... 62% 69.0M 2s 2024-09-14T21:24:56.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105300K .......... .......... .......... .......... .......... 62% 25.9M 2s 2024-09-14T21:24:56.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105350K .......... .......... .......... .......... .......... 62% 33.8M 2s 2024-09-14T21:24:56.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105400K .......... .......... .......... .......... .......... 62% 26.4M 2s 2024-09-14T21:24:56.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105450K .......... .......... .......... .......... .......... 62% 47.6M 2s 2024-09-14T21:24:56.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105500K .......... .......... .......... .......... .......... 62% 23.1M 2s 2024-09-14T21:24:56.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105550K .......... .......... .......... .......... .......... 62% 22.9M 2s 2024-09-14T21:24:56.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105600K .......... .......... .......... .......... .......... 62% 35.5M 2s 2024-09-14T21:24:56.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105650K .......... .......... .......... .......... .......... 62% 28.2M 2s 2024-09-14T21:24:56.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105700K .......... .......... .......... .......... .......... 62% 48.9M 2s 2024-09-14T21:24:56.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105750K .......... .......... .......... .......... .......... 62% 24.1M 2s 2024-09-14T21:24:56.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105800K .......... .......... .......... .......... .......... 62% 34.7M 2s 2024-09-14T21:24:56.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105850K .......... .......... .......... .......... .......... 62% 24.7M 2s 2024-09-14T21:24:56.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105900K .......... .......... .......... .......... .......... 62% 23.7M 2s 2024-09-14T21:24:56.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:105950K .......... .......... .......... .......... .......... 62% 24.3M 2s 2024-09-14T21:24:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106000K .......... .......... .......... .......... .......... 62% 32.9M 2s 2024-09-14T21:24:56.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106050K .......... .......... .......... .......... .......... 62% 32.5M 2s 2024-09-14T21:24:56.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106100K .......... .......... .......... .......... .......... 62% 37.0M 2s 2024-09-14T21:24:56.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106150K .......... .......... .......... .......... .......... 63% 24.4M 2s 2024-09-14T21:24:56.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106200K .......... .......... .......... .......... .......... 63% 48.6M 2s 2024-09-14T21:24:56.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106250K .......... .......... .......... .......... .......... 63% 24.1M 2s 2024-09-14T21:24:56.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106300K .......... .......... .......... .......... .......... 63% 23.4M 2s 2024-09-14T21:24:56.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106350K .......... .......... .......... .......... .......... 63% 37.6M 2s 2024-09-14T21:24:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106400K .......... .......... .......... .......... .......... 63% 21.3M 2s 2024-09-14T21:24:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106450K .......... .......... .......... .......... .......... 63% 27.2M 2s 2024-09-14T21:24:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106500K .......... .......... .......... .......... .......... 63% 52.6M 2s 2024-09-14T21:24:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106550K .......... .......... .......... .......... .......... 63% 24.3M 2s 2024-09-14T21:24:56.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106600K .......... .......... .......... .......... .......... 63% 41.3M 2s 2024-09-14T21:24:56.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106650K .......... .......... .......... .......... .......... 63% 24.3M 2s 2024-09-14T21:24:56.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106700K .......... .......... .......... .......... .......... 63% 45.1M 2s 2024-09-14T21:24:56.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106750K .......... .......... .......... .......... .......... 63% 23.7M 2s 2024-09-14T21:24:56.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106800K .......... .......... .......... .......... .......... 63% 22.0M 2s 2024-09-14T21:24:56.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106850K .......... .......... .......... .......... .......... 63% 38.0M 2s 2024-09-14T21:24:56.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106900K .......... .......... .......... .......... .......... 63% 21.1M 2s 2024-09-14T21:24:56.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:106950K .......... .......... .......... .......... .......... 63% 32.9M 2s 2024-09-14T21:24:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107000K .......... .......... .......... .......... .......... 63% 41.0M 2s 2024-09-14T21:24:56.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107050K .......... .......... .......... .......... .......... 63% 25.8M 2s 2024-09-14T21:24:56.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107100K .......... .......... .......... .......... .......... 63% 31.0M 2s 2024-09-14T21:24:56.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107150K .......... .......... .......... .......... .......... 63% 28.3M 2s 2024-09-14T21:24:56.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107200K .......... .......... .......... .......... .......... 63% 23.0M 2s 2024-09-14T21:24:56.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107250K .......... .......... .......... .......... .......... 63% 56.4M 2s 2024-09-14T21:24:56.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107300K .......... .......... .......... .......... .......... 63% 30.6M 2s 2024-09-14T21:24:56.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107350K .......... .......... .......... .......... .......... 63% 29.3M 2s 2024-09-14T21:24:56.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107400K .......... .......... .......... .......... .......... 63% 22.8M 2s 2024-09-14T21:24:56.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107450K .......... .......... .......... .......... .......... 63% 24.5M 2s 2024-09-14T21:24:56.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107500K .......... .......... .......... .......... .......... 63% 42.4M 2s 2024-09-14T21:24:56.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107550K .......... .......... .......... .......... .......... 63% 27.9M 2s 2024-09-14T21:24:56.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107600K .......... .......... .......... .......... .......... 63% 22.5M 2s 2024-09-14T21:24:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107650K .......... .......... .......... .......... .......... 63% 36.4M 2s 2024-09-14T21:24:57.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107700K .......... .......... .......... .......... .......... 63% 25.7M 2s 2024-09-14T21:24:57.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107750K .......... .......... .......... .......... .......... 63% 44.9M 2s 2024-09-14T21:24:57.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107800K .......... .......... .......... .......... .......... 63% 30.9M 2s 2024-09-14T21:24:57.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107850K .......... .......... .......... .......... .......... 64% 30.1M 2s 2024-09-14T21:24:57.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107900K .......... .......... .......... .......... .......... 64% 21.8M 2s 2024-09-14T21:24:57.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:107950K .......... .......... .......... .......... .......... 64% 26.5M 2s 2024-09-14T21:24:57.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108000K .......... .......... .......... .......... .......... 64% 22.7M 2s 2024-09-14T21:24:57.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108050K .......... .......... .......... .......... .......... 64% 39.2M 2s 2024-09-14T21:24:57.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108100K .......... .......... .......... .......... .......... 64% 40.5M 2s 2024-09-14T21:24:57.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108150K .......... .......... .......... .......... .......... 64% 21.7M 2s 2024-09-14T21:24:57.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108200K .......... .......... .......... .......... .......... 64% 27.6M 2s 2024-09-14T21:24:57.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108250K .......... .......... .......... .......... .......... 64% 50.0M 2s 2024-09-14T21:24:57.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108300K .......... .......... .......... .......... .......... 64% 22.4M 2s 2024-09-14T21:24:57.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108350K .......... .......... .......... .......... .......... 64% 37.3M 2s 2024-09-14T21:24:57.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108400K .......... .......... .......... .......... .......... 64% 27.3M 2s 2024-09-14T21:24:57.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108450K .......... .......... .......... .......... .......... 64% 23.3M 2s 2024-09-14T21:24:57.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108500K .......... .......... .......... .......... .......... 64% 43.4M 2s 2024-09-14T21:24:57.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108550K .......... .......... .......... .......... .......... 64% 29.0M 2s 2024-09-14T21:24:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108600K .......... .......... .......... .......... .......... 64% 21.5M 2s 2024-09-14T21:24:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108650K .......... .......... .......... .......... .......... 64% 39.6M 2s 2024-09-14T21:24:57.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108700K .......... .......... .......... .......... .......... 64% 23.5M 2s 2024-09-14T21:24:57.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108750K .......... .......... .......... .......... .......... 64% 23.5M 2s 2024-09-14T21:24:57.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108800K .......... .......... .......... .......... .......... 64% 68.3M 2s 2024-09-14T21:24:57.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108850K .......... .......... .......... .......... .......... 64% 22.2M 2s 2024-09-14T21:24:57.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108900K .......... .......... .......... .......... .......... 64% 23.1M 2s 2024-09-14T21:24:57.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:108950K .......... .......... .......... .......... .......... 64% 37.1M 2s 2024-09-14T21:24:57.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109000K .......... .......... .......... .......... .......... 64% 48.0M 2s 2024-09-14T21:24:57.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109050K .......... .......... .......... .......... .......... 64% 32.4M 2s 2024-09-14T21:24:57.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109100K .......... .......... .......... .......... .......... 64% 30.9M 2s 2024-09-14T21:24:57.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109150K .......... .......... .......... .......... .......... 64% 22.2M 2s 2024-09-14T21:24:57.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109200K .......... .......... .......... .......... .......... 64% 23.5M 2s 2024-09-14T21:24:57.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109250K .......... .......... .......... .......... .......... 64% 25.5M 2s 2024-09-14T21:24:57.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109300K .......... .......... .......... .......... .......... 64% 43.1M 2s 2024-09-14T21:24:57.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109350K .......... .......... .......... .......... .......... 64% 23.4M 2s 2024-09-14T21:24:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109400K .......... .......... .......... .......... .......... 64% 46.0M 2s 2024-09-14T21:24:57.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109450K .......... .......... .......... .......... .......... 64% 21.9M 2s 2024-09-14T21:24:57.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109500K .......... .......... .......... .......... .......... 64% 56.2M 2s 2024-09-14T21:24:57.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109550K .......... .......... .......... .......... .......... 65% 23.1M 2s 2024-09-14T21:24:57.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109600K .......... .......... .......... .......... .......... 65% 25.7M 2s 2024-09-14T21:24:57.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109650K .......... .......... .......... .......... .......... 65% 36.5M 2s 2024-09-14T21:24:57.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109700K .......... .......... .......... .......... .......... 65% 20.6M 2s 2024-09-14T21:24:57.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109750K .......... .......... .......... .......... .......... 65% 28.0M 2s 2024-09-14T21:24:57.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109800K .......... .......... .......... .......... .......... 65% 51.0M 2s 2024-09-14T21:24:57.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109850K .......... .......... .......... .......... .......... 65% 22.2M 2s 2024-09-14T21:24:57.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109900K .......... .......... .......... .......... .......... 65% 42.4M 2s 2024-09-14T21:24:57.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:109950K .......... .......... .......... .......... .......... 65% 24.9M 2s 2024-09-14T21:24:57.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110000K .......... .......... .......... .......... .......... 65% 23.5M 2s 2024-09-14T21:24:57.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110050K .......... .......... .......... .......... .......... 65% 50.5M 2s 2024-09-14T21:24:57.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110100K .......... .......... .......... .......... .......... 65% 25.7M 2s 2024-09-14T21:24:57.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110150K .......... .......... .......... .......... .......... 65% 35.1M 2s 2024-09-14T21:24:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110200K .......... .......... .......... .......... .......... 65% 23.0M 2s 2024-09-14T21:24:57.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110250K .......... .......... .......... .......... .......... 65% 22.5M 2s 2024-09-14T21:24:57.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110300K .......... .......... .......... .......... .......... 65% 50.8M 2s 2024-09-14T21:24:57.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110350K .......... .......... .......... .......... .......... 65% 27.7M 2s 2024-09-14T21:24:57.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110400K .......... .......... .......... .......... .......... 65% 22.3M 2s 2024-09-14T21:24:57.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110450K .......... .......... .......... .......... .......... 65% 38.9M 2s 2024-09-14T21:24:57.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110500K .......... .......... .......... .......... .......... 65% 22.4M 2s 2024-09-14T21:24:57.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110550K .......... .......... .......... .......... .......... 65% 48.0M 2s 2024-09-14T21:24:57.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110600K .......... .......... .......... .......... .......... 65% 24.0M 2s 2024-09-14T21:24:57.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110650K .......... .......... .......... .......... .......... 65% 42.2M 2s 2024-09-14T21:24:57.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110700K .......... .......... .......... .......... .......... 65% 22.2M 2s 2024-09-14T21:24:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110750K .......... .......... .......... .......... .......... 65% 26.5M 2s 2024-09-14T21:24:57.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110800K .......... .......... .......... .......... .......... 65% 20.1M 2s 2024-09-14T21:24:57.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110850K .......... .......... .......... .......... .......... 65% 57.9M 2s 2024-09-14T21:24:57.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110900K .......... .......... .......... .......... .......... 65% 33.9M 2s 2024-09-14T21:24:57.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:110950K .......... .......... .......... .......... .......... 65% 25.8M 2s 2024-09-14T21:24:57.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111000K .......... .......... .......... .......... .......... 65% 27.4M 2s 2024-09-14T21:24:57.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111050K .......... .......... .......... .......... .......... 65% 44.9M 2s 2024-09-14T21:24:57.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111100K .......... .......... .......... .......... .......... 65% 23.8M 2s 2024-09-14T21:24:57.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111150K .......... .......... .......... .......... .......... 65% 24.0M 2s 2024-09-14T21:24:57.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111200K .......... .......... .......... .......... .......... 65% 35.3M 2s 2024-09-14T21:24:57.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111250K .......... .......... .......... .......... .......... 66% 27.2M 2s 2024-09-14T21:24:57.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111300K .......... .......... .......... .......... .......... 66% 49.0M 2s 2024-09-14T21:24:57.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111350K .......... .......... .......... .......... .......... 66% 21.3M 2s 2024-09-14T21:24:57.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111400K .......... .......... .......... .......... .......... 66% 39.0M 2s 2024-09-14T21:24:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111450K .......... .......... .......... .......... .......... 66% 22.8M 2s 2024-09-14T21:24:57.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111500K .......... .......... .......... .......... .......... 66% 81.4M 2s 2024-09-14T21:24:57.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111550K .......... .......... .......... .......... .......... 66% 14.9M 2s 2024-09-14T21:24:57.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111600K .......... .......... .......... .......... .......... 66% 55.9M 2s 2024-09-14T21:24:57.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111650K .......... .......... .......... .......... .......... 66% 29.7M 2s 2024-09-14T21:24:57.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111700K .......... .......... .......... .......... .......... 66% 21.9M 2s 2024-09-14T21:24:57.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111750K .......... .......... .......... .......... .......... 66% 45.1M 2s 2024-09-14T21:24:57.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111800K .......... .......... .......... .......... .......... 66% 35.5M 2s 2024-09-14T21:24:57.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111850K .......... .......... .......... .......... .......... 66% 23.7M 2s 2024-09-14T21:24:57.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111900K .......... .......... .......... .......... .......... 66% 26.0M 2s 2024-09-14T21:24:57.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:111950K .......... .......... .......... .......... .......... 66% 25.6M 2s 2024-09-14T21:24:57.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112000K .......... .......... .......... .......... .......... 66% 27.9M 2s 2024-09-14T21:24:57.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112050K .......... .......... .......... .......... .......... 66% 41.6M 2s 2024-09-14T21:24:57.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112100K .......... .......... .......... .......... .......... 66% 25.9M 2s 2024-09-14T21:24:57.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112150K .......... .......... .......... .......... .......... 66% 23.8M 2s 2024-09-14T21:24:57.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112200K .......... .......... .......... .......... .......... 66% 39.5M 2s 2024-09-14T21:24:57.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112250K .......... .......... .......... .......... .......... 66% 26.0M 2s 2024-09-14T21:24:57.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112300K .......... .......... .......... .......... .......... 66% 35.9M 2s 2024-09-14T21:24:57.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112350K .......... .......... .......... .......... .......... 66% 23.2M 2s 2024-09-14T21:24:57.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112400K .......... .......... .......... .......... .......... 66% 22.1M 2s 2024-09-14T21:24:57.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112450K .......... .......... .......... .......... .......... 66% 88.7M 2s 2024-09-14T21:24:57.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112500K .......... .......... .......... .......... .......... 66% 24.0M 2s 2024-09-14T21:24:57.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112550K .......... .......... .......... .......... .......... 66% 29.8M 2s 2024-09-14T21:24:57.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112600K .......... .......... .......... .......... .......... 66% 34.3M 2s 2024-09-14T21:24:57.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112650K .......... .......... .......... .......... .......... 66% 29.5M 2s 2024-09-14T21:24:57.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112700K .......... .......... .......... .......... .......... 66% 23.3M 2s 2024-09-14T21:24:57.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112750K .......... .......... .......... .......... .......... 66% 27.8M 2s 2024-09-14T21:24:57.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112800K .......... .......... .......... .......... .......... 66% 24.3M 2s 2024-09-14T21:24:57.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112850K .......... .......... .......... .......... .......... 66% 43.4M 2s 2024-09-14T21:24:57.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112900K .......... .......... .......... .......... .......... 67% 25.1M 2s 2024-09-14T21:24:57.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:112950K .......... .......... .......... .......... .......... 67% 37.2M 2s 2024-09-14T21:24:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113000K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-09-14T21:24:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113050K .......... .......... .......... .......... .......... 67% 37.6M 2s 2024-09-14T21:24:57.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113100K .......... .......... .......... .......... .......... 67% 27.4M 2s 2024-09-14T21:24:57.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113150K .......... .......... .......... .......... .......... 67% 24.9M 2s 2024-09-14T21:24:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113200K .......... .......... .......... .......... .......... 67% 36.0M 2s 2024-09-14T21:24:57.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113250K .......... .......... .......... .......... .......... 67% 24.7M 2s 2024-09-14T21:24:57.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113300K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-09-14T21:24:57.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113350K .......... .......... .......... .......... .......... 67% 45.9M 2s 2024-09-14T21:24:57.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113400K .......... .......... .......... .......... .......... 67% 21.8M 2s 2024-09-14T21:24:57.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113450K .......... .......... .......... .......... .......... 67% 41.6M 2s 2024-09-14T21:24:57.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113500K .......... .......... .......... .......... .......... 67% 30.3M 2s 2024-09-14T21:24:57.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113550K .......... .......... .......... .......... .......... 67% 19.6M 2s 2024-09-14T21:24:57.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113600K .......... .......... .......... .......... .......... 67% 51.8M 2s 2024-09-14T21:24:57.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113650K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-09-14T21:24:57.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113700K .......... .......... .......... .......... .......... 67% 27.3M 2s 2024-09-14T21:24:57.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113750K .......... .......... .......... .......... .......... 67% 26.6M 2s 2024-09-14T21:24:57.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113800K .......... .......... .......... .......... .......... 67% 31.3M 2s 2024-09-14T21:24:57.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113850K .......... .......... .......... .......... .......... 67% 34.4M 2s 2024-09-14T21:24:57.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113900K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-09-14T21:24:57.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:113950K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-09-14T21:24:57.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114000K .......... .......... .......... .......... .......... 67% 38.5M 2s 2024-09-14T21:24:57.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114050K .......... .......... .......... .......... .......... 67% 26.0M 2s 2024-09-14T21:24:57.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114100K .......... .......... .......... .......... .......... 67% 42.3M 2s 2024-09-14T21:24:57.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114150K .......... .......... .......... .......... .......... 67% 25.4M 2s 2024-09-14T21:24:57.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114200K .......... .......... .......... .......... .......... 67% 39.3M 2s 2024-09-14T21:24:57.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114250K .......... .......... .......... .......... .......... 67% 22.6M 2s 2024-09-14T21:24:57.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114300K .......... .......... .......... .......... .......... 67% 22.2M 2s 2024-09-14T21:24:57.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114350K .......... .......... .......... .......... .......... 67% 26.7M 2s 2024-09-14T21:24:57.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114400K .......... .......... .......... .......... .......... 67% 39.2M 2s 2024-09-14T21:24:57.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114450K .......... .......... .......... .......... .......... 67% 26.0M 2s 2024-09-14T21:24:57.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114500K .......... .......... .......... .......... .......... 67% 39.8M 2s 2024-09-14T21:24:57.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114550K .......... .......... .......... .......... .......... 67% 23.3M 2s 2024-09-14T21:24:57.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114600K .......... .......... .......... .......... .......... 68% 45.9M 2s 2024-09-14T21:24:57.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114650K .......... .......... .......... .......... .......... 68% 27.8M 2s 2024-09-14T21:24:57.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114700K .......... .......... .......... .......... .......... 68% 24.8M 2s 2024-09-14T21:24:57.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114750K .......... .......... .......... .......... .......... 68% 36.0M 2s 2024-09-14T21:24:57.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114800K .......... .......... .......... .......... .......... 68% 22.1M 2s 2024-09-14T21:24:57.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114850K .......... .......... .......... .......... .......... 68% 24.4M 2s 2024-09-14T21:24:57.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114900K .......... .......... .......... .......... .......... 68% 50.8M 2s 2024-09-14T21:24:57.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:114950K .......... .......... .......... .......... .......... 68% 24.4M 2s 2024-09-14T21:24:57.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115000K .......... .......... .......... .......... .......... 68% 35.8M 2s 2024-09-14T21:24:57.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115050K .......... .......... .......... .......... .......... 68% 25.2M 2s 2024-09-14T21:24:57.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115100K .......... .......... .......... .......... .......... 68% 41.6M 2s 2024-09-14T21:24:57.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115150K .......... .......... .......... .......... .......... 68% 24.8M 2s 2024-09-14T21:24:57.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115200K .......... .......... .......... .......... .......... 68% 27.1M 2s 2024-09-14T21:24:57.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115250K .......... .......... .......... .......... .......... 68% 37.3M 2s 2024-09-14T21:24:57.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115300K .......... .......... .......... .......... .......... 68% 21.6M 2s 2024-09-14T21:24:57.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115350K .......... .......... .......... .......... .......... 68% 25.3M 2s 2024-09-14T21:24:57.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115400K .......... .......... .......... .......... .......... 68% 43.7M 2s 2024-09-14T21:24:57.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115450K .......... .......... .......... .......... .......... 68% 37.5M 2s 2024-09-14T21:24:57.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115500K .......... .......... .......... .......... .......... 68% 27.4M 2s 2024-09-14T21:24:57.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115550K .......... .......... .......... .......... .......... 68% 21.6M 2s 2024-09-14T21:24:57.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115600K .......... .......... .......... .......... .......... 68% 27.9M 2s 2024-09-14T21:24:57.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115650K .......... .......... .......... .......... .......... 68% 35.2M 2s 2024-09-14T21:24:57.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115700K .......... .......... .......... .......... .......... 68% 27.5M 2s 2024-09-14T21:24:57.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115750K .......... .......... .......... .......... .......... 68% 41.7M 2s 2024-09-14T21:24:57.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115800K .......... .......... .......... .......... .......... 68% 22.8M 2s 2024-09-14T21:24:57.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115850K .......... .......... .......... .......... .......... 68% 54.5M 2s 2024-09-14T21:24:57.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115900K .......... .......... .......... .......... .......... 68% 23.3M 2s 2024-09-14T21:24:57.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:115950K .......... .......... .......... .......... .......... 68% 21.7M 2s 2024-09-14T21:24:57.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116000K .......... .......... .......... .......... .......... 68% 42.6M 2s 2024-09-14T21:24:57.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116050K .......... .......... .......... .......... .......... 68% 26.3M 2s 2024-09-14T21:24:57.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116100K .......... .......... .......... .......... .......... 68% 22.4M 2s 2024-09-14T21:24:57.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116150K .......... .......... .......... .......... .......... 68% 48.7M 2s 2024-09-14T21:24:57.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116200K .......... .......... .......... .......... .......... 68% 24.8M 2s 2024-09-14T21:24:57.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116250K .......... .......... .......... .......... .......... 68% 29.0M 2s 2024-09-14T21:24:57.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116300K .......... .......... .......... .......... .......... 69% 26.9M 2s 2024-09-14T21:24:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116350K .......... .......... .......... .......... .......... 69% 26.7M 2s 2024-09-14T21:24:57.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116400K .......... .......... .......... .......... .......... 69% 47.1M 2s 2024-09-14T21:24:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116450K .......... .......... .......... .......... .......... 69% 23.9M 2s 2024-09-14T21:24:57.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116500K .......... .......... .......... .......... .......... 69% 33.9M 2s 2024-09-14T21:24:57.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116550K .......... .......... .......... .......... .......... 69% 25.4M 2s 2024-09-14T21:24:57.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116600K .......... .......... .......... .......... .......... 69% 43.0M 2s 2024-09-14T21:24:57.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116650K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-09-14T21:24:57.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116700K .......... .......... .......... .......... .......... 69% 31.2M 2s 2024-09-14T21:24:57.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116750K .......... .......... .......... .......... .......... 69% 19.5M 2s 2024-09-14T21:24:57.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116800K .......... .......... .......... .......... .......... 69% 45.3M 2s 2024-09-14T21:24:57.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116850K .......... .......... .......... .......... .......... 69% 22.3M 2s 2024-09-14T21:24:57.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116900K .......... .......... .......... .......... .......... 69% 57.3M 2s 2024-09-14T21:24:57.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:116950K .......... .......... .......... .......... .......... 69% 31.5M 2s 2024-09-14T21:24:57.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117000K .......... .......... .......... .......... .......... 69% 26.5M 2s 2024-09-14T21:24:57.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117050K .......... .......... .......... .......... .......... 69% 25.3M 2s 2024-09-14T21:24:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117100K .......... .......... .......... .......... .......... 69% 24.2M 2s 2024-09-14T21:24:57.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117150K .......... .......... .......... .......... .......... 69% 26.2M 2s 2024-09-14T21:24:57.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117200K .......... .......... .......... .......... .......... 69% 40.4M 2s 2024-09-14T21:24:57.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117250K .......... .......... .......... .......... .......... 69% 25.7M 2s 2024-09-14T21:24:57.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117300K .......... .......... .......... .......... .......... 69% 35.6M 2s 2024-09-14T21:24:57.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117350K .......... .......... .......... .......... .......... 69% 22.4M 2s 2024-09-14T21:24:57.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117400K .......... .......... .......... .......... .......... 69% 51.3M 2s 2024-09-14T21:24:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117450K .......... .......... .......... .......... .......... 69% 21.8M 2s 2024-09-14T21:24:57.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117500K .......... .......... .......... .......... .......... 69% 41.7M 2s 2024-09-14T21:24:57.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117550K .......... .......... .......... .......... .......... 69% 20.1M 2s 2024-09-14T21:24:57.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117600K .......... .......... .......... .......... .......... 69% 32.8M 2s 2024-09-14T21:24:57.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117650K .......... .......... .......... .......... .......... 69% 24.1M 2s 2024-09-14T21:24:57.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117700K .......... .......... .......... .......... .......... 69% 50.0M 2s 2024-09-14T21:24:57.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117750K .......... .......... .......... .......... .......... 69% 20.1M 2s 2024-09-14T21:24:57.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117800K .......... .......... .......... .......... .......... 69% 49.8M 2s 2024-09-14T21:24:57.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117850K .......... .......... .......... .......... .......... 69% 11.5M 2s 2024-09-14T21:24:57.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117900K .......... .......... .......... .......... .......... 69% 117M 2s 2024-09-14T21:24:57.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:117950K .......... .......... .......... .......... .......... 70% 38.4M 2s 2024-09-14T21:24:57.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118000K .......... .......... .......... .......... .......... 70% 32.5M 2s 2024-09-14T21:24:57.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118050K .......... .......... .......... .......... .......... 70% 31.2M 2s 2024-09-14T21:24:57.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118100K .......... .......... .......... .......... .......... 70% 20.3M 2s 2024-09-14T21:24:57.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118150K .......... .......... .......... .......... .......... 70% 57.2M 2s 2024-09-14T21:24:57.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118200K .......... .......... .......... .......... .......... 70% 24.2M 2s 2024-09-14T21:24:57.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118250K .......... .......... .......... .......... .......... 70% 35.2M 2s 2024-09-14T21:24:57.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118300K .......... .......... .......... .......... .......... 70% 28.6M 2s 2024-09-14T21:24:57.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118350K .......... .......... .......... .......... .......... 70% 30.2M 2s 2024-09-14T21:24:57.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118400K .......... .......... .......... .......... .......... 70% 26.3M 2s 2024-09-14T21:24:57.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118450K .......... .......... .......... .......... .......... 70% 47.7M 2s 2024-09-14T21:24:57.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118500K .......... .......... .......... .......... .......... 70% 29.9M 2s 2024-09-14T21:24:57.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118550K .......... .......... .......... .......... .......... 70% 27.3M 2s 2024-09-14T21:24:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118600K .......... .......... .......... .......... .......... 70% 23.6M 2s 2024-09-14T21:24:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118650K .......... .......... .......... .......... .......... 70% 56.3M 2s 2024-09-14T21:24:57.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118700K .......... .......... .......... .......... .......... 70% 24.4M 2s 2024-09-14T21:24:57.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118750K .......... .......... .......... .......... .......... 70% 27.1M 2s 2024-09-14T21:24:57.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118800K .......... .......... .......... .......... .......... 70% 29.4M 2s 2024-09-14T21:24:57.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118850K .......... .......... .......... .......... .......... 70% 21.4M 2s 2024-09-14T21:24:57.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118900K .......... .......... .......... .......... .......... 70% 29.3M 2s 2024-09-14T21:24:57.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:118950K .......... .......... .......... .......... .......... 70% 49.3M 2s 2024-09-14T21:24:57.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119000K .......... .......... .......... .......... .......... 70% 25.2M 2s 2024-09-14T21:24:57.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119050K .......... .......... .......... .......... .......... 70% 33.6M 2s 2024-09-14T21:24:57.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119100K .......... .......... .......... .......... .......... 70% 24.9M 2s 2024-09-14T21:24:57.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119150K .......... .......... .......... .......... .......... 70% 24.6M 2s 2024-09-14T21:24:57.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119200K .......... .......... .......... .......... .......... 70% 44.9M 2s 2024-09-14T21:24:57.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119250K .......... .......... .......... .......... .......... 70% 25.6M 2s 2024-09-14T21:24:57.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119300K .......... .......... .......... .......... .......... 70% 36.2M 2s 2024-09-14T21:24:57.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119350K .......... .......... .......... .......... .......... 70% 18.0M 2s 2024-09-14T21:24:57.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119400K .......... .......... .......... .......... .......... 70% 23.8M 2s 2024-09-14T21:24:57.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119450K .......... .......... .......... .......... .......... 70% 74.1M 2s 2024-09-14T21:24:57.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119500K .......... .......... .......... .......... .......... 70% 23.2M 2s 2024-09-14T21:24:57.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119550K .......... .......... .......... .......... .......... 70% 23.9M 2s 2024-09-14T21:24:57.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119600K .......... .......... .......... .......... .......... 70% 31.0M 2s 2024-09-14T21:24:57.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119650K .......... .......... .......... .......... .......... 71% 27.7M 2s 2024-09-14T21:24:57.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119700K .......... .......... .......... .......... .......... 71% 34.4M 2s 2024-09-14T21:24:57.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119750K .......... .......... .......... .......... .......... 71% 30.5M 2s 2024-09-14T21:24:57.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119800K .......... .......... .......... .......... .......... 71% 31.6M 2s 2024-09-14T21:24:57.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119850K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-09-14T21:24:57.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119900K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-09-14T21:24:57.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:119950K .......... .......... .......... .......... .......... 71% 26.3M 2s 2024-09-14T21:24:57.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120000K .......... .......... .......... .......... .......... 71% 48.4M 2s 2024-09-14T21:24:57.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120050K .......... .......... .......... .......... .......... 71% 24.4M 2s 2024-09-14T21:24:57.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120100K .......... .......... .......... .......... .......... 71% 35.6M 2s 2024-09-14T21:24:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120150K .......... .......... .......... .......... .......... 71% 25.2M 2s 2024-09-14T21:24:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120200K .......... .......... .......... .......... .......... 71% 46.0M 2s 2024-09-14T21:24:57.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120250K .......... .......... .......... .......... .......... 71% 24.8M 2s 2024-09-14T21:24:57.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120300K .......... .......... .......... .......... .......... 71% 37.5M 2s 2024-09-14T21:24:57.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120350K .......... .......... .......... .......... .......... 71% 23.4M 2s 2024-09-14T21:24:57.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120400K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-09-14T21:24:57.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120450K .......... .......... .......... .......... .......... 71% 23.0M 2s 2024-09-14T21:24:57.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120500K .......... .......... .......... .......... .......... 71% 52.3M 2s 2024-09-14T21:24:57.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120550K .......... .......... .......... .......... .......... 71% 34.3M 2s 2024-09-14T21:24:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120600K .......... .......... .......... .......... .......... 71% 26.1M 2s 2024-09-14T21:24:57.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120650K .......... .......... .......... .......... .......... 71% 23.7M 2s 2024-09-14T21:24:57.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120700K .......... .......... .......... .......... .......... 71% 46.7M 2s 2024-09-14T21:24:57.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120750K .......... .......... .......... .......... .......... 71% 22.1M 2s 2024-09-14T21:24:57.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120800K .......... .......... .......... .......... .......... 71% 27.6M 2s 2024-09-14T21:24:57.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120850K .......... .......... .......... .......... .......... 71% 35.7M 2s 2024-09-14T21:24:57.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120900K .......... .......... .......... .......... .......... 71% 24.1M 2s 2024-09-14T21:24:57.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:120950K .......... .......... .......... .......... .......... 71% 42.7M 2s 2024-09-14T21:24:57.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121000K .......... .......... .......... .......... .......... 71% 24.7M 2s 2024-09-14T21:24:57.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121050K .......... .......... .......... .......... .......... 71% 36.8M 2s 2024-09-14T21:24:57.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121100K .......... .......... .......... .......... .......... 71% 23.3M 2s 2024-09-14T21:24:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121150K .......... .......... .......... .......... .......... 71% 23.1M 2s 2024-09-14T21:24:57.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121200K .......... .......... .......... .......... .......... 71% 26.9M 2s 2024-09-14T21:24:57.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121250K .......... .......... .......... .......... .......... 71% 60.0M 2s 2024-09-14T21:24:57.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121300K .......... .......... .......... .......... .......... 71% 22.4M 2s 2024-09-14T21:24:57.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121350K .......... .......... .......... .......... .......... 72% 33.7M 2s 2024-09-14T21:24:57.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121400K .......... .......... .......... .......... .......... 72% 25.8M 2s 2024-09-14T21:24:57.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121450K .......... .......... .......... .......... .......... 72% 42.9M 2s 2024-09-14T21:24:57.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121500K .......... .......... .......... .......... .......... 72% 28.7M 2s 2024-09-14T21:24:57.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121550K .......... .......... .......... .......... .......... 72% 24.2M 2s 2024-09-14T21:24:57.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121600K .......... .......... .......... .......... .......... 72% 27.1M 2s 2024-09-14T21:24:57.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121650K .......... .......... .......... .......... .......... 72% 29.2M 2s 2024-09-14T21:24:57.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121700K .......... .......... .......... .......... .......... 72% 33.4M 2s 2024-09-14T21:24:57.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121750K .......... .......... .......... .......... .......... 72% 31.4M 2s 2024-09-14T21:24:57.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121800K .......... .......... .......... .......... .......... 72% 32.3M 2s 2024-09-14T21:24:57.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121850K .......... .......... .......... .......... .......... 72% 28.9M 2s 2024-09-14T21:24:57.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121900K .......... .......... .......... .......... .......... 72% 20.8M 2s 2024-09-14T21:24:57.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:121950K .......... .......... .......... .......... .......... 72% 27.9M 2s 2024-09-14T21:24:57.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122000K .......... .......... .......... .......... .......... 72% 48.3M 2s 2024-09-14T21:24:57.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122050K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-09-14T21:24:57.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122100K .......... .......... .......... .......... .......... 72% 36.0M 2s 2024-09-14T21:24:57.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122150K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-09-14T21:24:57.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122200K .......... .......... .......... .......... .......... 72% 27.3M 2s 2024-09-14T21:24:57.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122250K .......... .......... .......... .......... .......... 72% 37.2M 2s 2024-09-14T21:24:57.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122300K .......... .......... .......... .......... .......... 72% 26.6M 2s 2024-09-14T21:24:57.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122350K .......... .......... .......... .......... .......... 72% 31.3M 2s 2024-09-14T21:24:57.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122400K .......... .......... .......... .......... .......... 72% 21.3M 2s 2024-09-14T21:24:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122450K .......... .......... .......... .......... .......... 72% 33.3M 2s 2024-09-14T21:24:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122500K .......... .......... .......... .......... .......... 72% 61.1M 2s 2024-09-14T21:24:57.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122550K .......... .......... .......... .......... .......... 72% 20.9M 2s 2024-09-14T21:24:57.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122600K .......... .......... .......... .......... .......... 72% 42.3M 2s 2024-09-14T21:24:57.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122650K .......... .......... .......... .......... .......... 72% 19.5M 2s 2024-09-14T21:24:57.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122700K .......... .......... .......... .......... .......... 72% 66.4M 2s 2024-09-14T21:24:57.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122750K .......... .......... .......... .......... .......... 72% 22.4M 2s 2024-09-14T21:24:57.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122800K .......... .......... .......... .......... .......... 72% 34.6M 2s 2024-09-14T21:24:57.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122850K .......... .......... .......... .......... .......... 72% 24.4M 2s 2024-09-14T21:24:57.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122900K .......... .......... .......... .......... .......... 72% 32.8M 2s 2024-09-14T21:24:57.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:122950K .......... .......... .......... .......... .......... 72% 32.6M 2s 2024-09-14T21:24:57.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123000K .......... .......... .......... .......... .......... 72% 27.8M 2s 2024-09-14T21:24:57.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123050K .......... .......... .......... .......... .......... 73% 26.5M 2s 2024-09-14T21:24:57.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123100K .......... .......... .......... .......... .......... 73% 32.7M 2s 2024-09-14T21:24:57.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123150K .......... .......... .......... .......... .......... 73% 19.9M 2s 2024-09-14T21:24:57.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123200K .......... .......... .......... .......... .......... 73% 29.1M 2s 2024-09-14T21:24:57.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123250K .......... .......... .......... .......... .......... 73% 35.2M 2s 2024-09-14T21:24:57.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123300K .......... .......... .......... .......... .......... 73% 30.5M 2s 2024-09-14T21:24:57.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123350K .......... .......... .......... .......... .......... 73% 24.8M 2s 2024-09-14T21:24:57.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123400K .......... .......... .......... .......... .......... 73% 34.6M 2s 2024-09-14T21:24:57.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123450K .......... .......... .......... .......... .......... 73% 30.6M 2s 2024-09-14T21:24:57.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123500K .......... .......... .......... .......... .......... 73% 34.1M 2s 2024-09-14T21:24:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123550K .......... .......... .......... .......... .......... 73% 26.4M 2s 2024-09-14T21:24:57.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123600K .......... .......... .......... .......... .......... 73% 20.2M 2s 2024-09-14T21:24:57.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123650K .......... .......... .......... .......... .......... 73% 45.5M 2s 2024-09-14T21:24:57.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123700K .......... .......... .......... .......... .......... 73% 24.2M 2s 2024-09-14T21:24:57.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123750K .......... .......... .......... .......... .......... 73% 30.3M 2s 2024-09-14T21:24:57.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123800K .......... .......... .......... .......... .......... 73% 28.7M 2s 2024-09-14T21:24:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123850K .......... .......... .......... .......... .......... 73% 25.1M 2s 2024-09-14T21:24:57.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123900K .......... .......... .......... .......... .......... 73% 57.1M 2s 2024-09-14T21:24:57.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:123950K .......... .......... .......... .......... .......... 73% 22.6M 2s 2024-09-14T21:24:57.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124000K .......... .......... .......... .......... .......... 73% 27.7M 2s 2024-09-14T21:24:57.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124050K .......... .......... .......... .......... .......... 73% 36.6M 2s 2024-09-14T21:24:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124100K .......... .......... .......... .......... .......... 73% 22.7M 2s 2024-09-14T21:24:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124150K .......... .......... .......... .......... .......... 73% 38.5M 2s 2024-09-14T21:24:57.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124200K .......... .......... .......... .......... .......... 73% 22.1M 2s 2024-09-14T21:24:57.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124250K .......... .......... .......... .......... .......... 73% 49.0M 2s 2024-09-14T21:24:57.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124300K .......... .......... .......... .......... .......... 73% 27.0M 2s 2024-09-14T21:24:57.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124350K .......... .......... .......... .......... .......... 73% 22.5M 2s 2024-09-14T21:24:57.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124400K .......... .......... .......... .......... .......... 73% 31.1M 2s 2024-09-14T21:24:57.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124450K .......... .......... .......... .......... .......... 73% 26.6M 2s 2024-09-14T21:24:57.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124500K .......... .......... .......... .......... .......... 73% 26.2M 2s 2024-09-14T21:24:57.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124550K .......... .......... .......... .......... .......... 73% 53.7M 2s 2024-09-14T21:24:57.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124600K .......... .......... .......... .......... .......... 73% 34.1M 2s 2024-09-14T21:24:57.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124650K .......... .......... .......... .......... .......... 73% 28.0M 2s 2024-09-14T21:24:57.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124700K .......... .......... .......... .......... .......... 74% 20.6M 2s 2024-09-14T21:24:57.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124750K .......... .......... .......... .......... .......... 74% 26.8M 2s 2024-09-14T21:24:57.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124800K .......... .......... .......... .......... .......... 74% 46.8M 1s 2024-09-14T21:24:57.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124850K .......... .......... .......... .......... .......... 74% 28.5M 1s 2024-09-14T21:24:57.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124900K .......... .......... .......... .......... .......... 74% 29.4M 1s 2024-09-14T21:24:57.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:124950K .......... .......... .......... .......... .......... 74% 24.8M 1s 2024-09-14T21:24:57.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125000K .......... .......... .......... .......... .......... 74% 20.7M 1s 2024-09-14T21:24:57.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125050K .......... .......... .......... .......... .......... 74% 69.1M 1s 2024-09-14T21:24:57.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125100K .......... .......... .......... .......... .......... 74% 32.2M 1s 2024-09-14T21:24:57.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125150K .......... .......... .......... .......... .......... 74% 19.4M 1s 2024-09-14T21:24:57.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125200K .......... .......... .......... .......... .......... 74% 32.8M 1s 2024-09-14T21:24:57.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125250K .......... .......... .......... .......... .......... 74% 25.6M 1s 2024-09-14T21:24:57.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125300K .......... .......... .......... .......... .......... 74% 42.7M 1s 2024-09-14T21:24:57.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125350K .......... .......... .......... .......... .......... 74% 26.9M 1s 2024-09-14T21:24:57.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125400K .......... .......... .......... .......... .......... 74% 26.9M 1s 2024-09-14T21:24:57.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125450K .......... .......... .......... .......... .......... 74% 32.3M 1s 2024-09-14T21:24:57.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125500K .......... .......... .......... .......... .......... 74% 41.0M 1s 2024-09-14T21:24:57.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125550K .......... .......... .......... .......... .......... 74% 16.1M 1s 2024-09-14T21:24:57.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125600K .......... .......... .......... .......... .......... 74% 60.0M 1s 2024-09-14T21:24:57.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125650K .......... .......... .......... .......... .......... 74% 22.7M 1s 2024-09-14T21:24:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125700K .......... .......... .......... .......... .......... 74% 31.2M 1s 2024-09-14T21:24:57.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125750K .......... .......... .......... .......... .......... 74% 23.8M 1s 2024-09-14T21:24:57.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125800K .......... .......... .......... .......... .......... 74% 71.0M 1s 2024-09-14T21:24:57.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125850K .......... .......... .......... .......... .......... 74% 24.2M 1s 2024-09-14T21:24:57.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125900K .......... .......... .......... .......... .......... 74% 29.4M 1s 2024-09-14T21:24:57.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:125950K .......... .......... .......... .......... .......... 74% 29.2M 1s 2024-09-14T21:24:57.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126000K .......... .......... .......... .......... .......... 74% 18.3M 1s 2024-09-14T21:24:57.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126050K .......... .......... .......... .......... .......... 74% 82.1M 1s 2024-09-14T21:24:57.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126100K .......... .......... .......... .......... .......... 74% 25.1M 1s 2024-09-14T21:24:57.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126150K .......... .......... .......... .......... .......... 74% 40.6M 1s 2024-09-14T21:24:57.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126200K .......... .......... .......... .......... .......... 74% 20.8M 1s 2024-09-14T21:24:57.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126250K .......... .......... .......... .......... .......... 74% 28.6M 1s 2024-09-14T21:24:57.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126300K .......... .......... .......... .......... .......... 74% 48.6M 1s 2024-09-14T21:24:57.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126350K .......... .......... .......... .......... .......... 74% 20.8M 1s 2024-09-14T21:24:57.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126400K .......... .......... .......... .......... .......... 75% 28.0M 1s 2024-09-14T21:24:57.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126450K .......... .......... .......... .......... .......... 75% 41.3M 1s 2024-09-14T21:24:57.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126500K .......... .......... .......... .......... .......... 75% 24.5M 1s 2024-09-14T21:24:57.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126550K .......... .......... .......... .......... .......... 75% 44.9M 1s 2024-09-14T21:24:57.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126600K .......... .......... .......... .......... .......... 75% 23.9M 1s 2024-09-14T21:24:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126650K .......... .......... .......... .......... .......... 75% 31.5M 1s 2024-09-14T21:24:57.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126700K .......... .......... .......... .......... .......... 75% 27.5M 1s 2024-09-14T21:24:57.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126750K .......... .......... .......... .......... .......... 75% 27.2M 1s 2024-09-14T21:24:57.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126800K .......... .......... .......... .......... .......... 75% 22.2M 1s 2024-09-14T21:24:57.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126850K .......... .......... .......... .......... .......... 75% 29.7M 1s 2024-09-14T21:24:57.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126900K .......... .......... .......... .......... .......... 75% 36.6M 1s 2024-09-14T21:24:57.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:126950K .......... .......... .......... .......... .......... 75% 26.6M 1s 2024-09-14T21:24:57.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127000K .......... .......... .......... .......... .......... 75% 29.2M 1s 2024-09-14T21:24:57.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127050K .......... .......... .......... .......... .......... 75% 40.7M 1s 2024-09-14T21:24:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127100K .......... .......... .......... .......... .......... 75% 23.3M 1s 2024-09-14T21:24:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127150K .......... .......... .......... .......... .......... 75% 28.4M 1s 2024-09-14T21:24:57.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127200K .......... .......... .......... .......... .......... 75% 28.4M 1s 2024-09-14T21:24:57.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127250K .......... .......... .......... .......... .......... 75% 30.1M 1s 2024-09-14T21:24:57.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127300K .......... .......... .......... .......... .......... 75% 35.2M 1s 2024-09-14T21:24:57.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127350K .......... .......... .......... .......... .......... 75% 35.1M 1s 2024-09-14T21:24:57.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127400K .......... .......... .......... .......... .......... 75% 27.9M 1s 2024-09-14T21:24:57.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127450K .......... .......... .......... .......... .......... 75% 28.9M 1s 2024-09-14T21:24:57.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127500K .......... .......... .......... .......... .......... 75% 22.5M 1s 2024-09-14T21:24:57.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127550K .......... .......... .......... .......... .......... 75% 25.3M 1s 2024-09-14T21:24:57.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127600K .......... .......... .......... .......... .......... 75% 40.9M 1s 2024-09-14T21:24:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127650K .......... .......... .......... .......... .......... 75% 37.9M 1s 2024-09-14T21:24:57.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127700K .......... .......... .......... .......... .......... 75% 22.7M 1s 2024-09-14T21:24:57.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127750K .......... .......... .......... .......... .......... 75% 27.0M 1s 2024-09-14T21:24:57.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127800K .......... .......... .......... .......... .......... 75% 24.7M 1s 2024-09-14T21:24:57.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127850K .......... .......... .......... .......... .......... 75% 35.7M 1s 2024-09-14T21:24:57.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127900K .......... .......... .......... .......... .......... 75% 41.5M 1s 2024-09-14T21:24:57.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:127950K .......... .......... .......... .......... .......... 75% 18.8M 1s 2024-09-14T21:24:57.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128000K .......... .......... .......... .......... .......... 75% 29.1M 1s 2024-09-14T21:24:57.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128050K .......... .......... .......... .......... .......... 75% 27.4M 1s 2024-09-14T21:24:57.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128100K .......... .......... .......... .......... .......... 76% 45.8M 1s 2024-09-14T21:24:57.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128150K .......... .......... .......... .......... .......... 76% 27.4M 1s 2024-09-14T21:24:57.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128200K .......... .......... .......... .......... .......... 76% 32.1M 1s 2024-09-14T21:24:57.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128250K .......... .......... .......... .......... .......... 76% 24.2M 1s 2024-09-14T21:24:57.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128300K .......... .......... .......... .......... .......... 76% 77.1M 1s 2024-09-14T21:24:57.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128350K .......... .......... .......... .......... .......... 76% 15.8M 1s 2024-09-14T21:24:57.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128400K .......... .......... .......... .......... .......... 76% 48.4M 1s 2024-09-14T21:24:57.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128450K .......... .......... .......... .......... .......... 76% 31.3M 1s 2024-09-14T21:24:57.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128500K .......... .......... .......... .......... .......... 76% 28.2M 1s 2024-09-14T21:24:57.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128550K .......... .......... .......... .......... .......... 76% 21.8M 1s 2024-09-14T21:24:57.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128600K .......... .......... .......... .......... .......... 76% 46.4M 1s 2024-09-14T21:24:57.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128650K .......... .......... .......... .......... .......... 76% 28.7M 1s 2024-09-14T21:24:57.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128700K .......... .......... .......... .......... .......... 76% 35.4M 1s 2024-09-14T21:24:57.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128750K .......... .......... .......... .......... .......... 76% 22.0M 1s 2024-09-14T21:24:57.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128800K .......... .......... .......... .......... .......... 76% 22.2M 1s 2024-09-14T21:24:57.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128850K .......... .......... .......... .......... .......... 76% 135M 1s 2024-09-14T21:24:57.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128900K .......... .......... .......... .......... .......... 76% 22.2M 1s 2024-09-14T21:24:57.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:128950K .......... .......... .......... .......... .......... 76% 30.9M 1s 2024-09-14T21:24:57.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129000K .......... .......... .......... .......... .......... 76% 27.6M 1s 2024-09-14T21:24:57.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129050K .......... .......... .......... .......... .......... 76% 20.0M 1s 2024-09-14T21:24:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129100K .......... .......... .......... .......... .......... 76% 58.3M 1s 2024-09-14T21:24:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129150K .......... .......... .......... .......... .......... 76% 21.6M 1s 2024-09-14T21:24:57.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129200K .......... .......... .......... .......... .......... 76% 31.7M 1s 2024-09-14T21:24:57.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129250K .......... .......... .......... .......... .......... 76% 36.2M 1s 2024-09-14T21:24:57.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129300K .......... .......... .......... .......... .......... 76% 22.3M 1s 2024-09-14T21:24:57.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129350K .......... .......... .......... .......... .......... 76% 70.4M 1s 2024-09-14T21:24:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129400K .......... .......... .......... .......... .......... 76% 21.5M 1s 2024-09-14T21:24:57.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129450K .......... .......... .......... .......... .......... 76% 40.3M 1s 2024-09-14T21:24:57.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129500K .......... .......... .......... .......... .......... 76% 25.9M 1s 2024-09-14T21:24:57.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129550K .......... .......... .......... .......... .......... 76% 20.9M 1s 2024-09-14T21:24:57.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129600K .......... .......... .......... .......... .......... 76% 22.1M 1s 2024-09-14T21:24:57.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129650K .......... .......... .......... .......... .......... 76% 64.7M 1s 2024-09-14T21:24:57.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129700K .......... .......... .......... .......... .......... 76% 27.4M 1s 2024-09-14T21:24:57.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129750K .......... .......... .......... .......... .......... 77% 28.4M 1s 2024-09-14T21:24:57.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129800K .......... .......... .......... .......... .......... 77% 26.8M 1s 2024-09-14T21:24:57.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129850K .......... .......... .......... .......... .......... 77% 22.4M 1s 2024-09-14T21:24:57.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129900K .......... .......... .......... .......... .......... 77% 26.2M 1s 2024-09-14T21:24:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:129950K .......... .......... .......... .......... .......... 77% 27.5M 1s 2024-09-14T21:24:57.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130000K .......... .......... .......... .......... .......... 77% 66.4M 1s 2024-09-14T21:24:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130050K .......... .......... .......... .......... .......... 77% 22.1M 1s 2024-09-14T21:24:57.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130100K .......... .......... .......... .......... .......... 77% 27.6M 1s 2024-09-14T21:24:57.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130150K .......... .......... .......... .......... .......... 77% 47.3M 1s 2024-09-14T21:24:57.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130200K .......... .......... .......... .......... .......... 77% 34.9M 1s 2024-09-14T21:24:57.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130250K .......... .......... .......... .......... .......... 77% 28.1M 1s 2024-09-14T21:24:57.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130300K .......... .......... .......... .......... .......... 77% 25.3M 1s 2024-09-14T21:24:57.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130350K .......... .......... .......... .......... .......... 77% 23.0M 1s 2024-09-14T21:24:57.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130400K .......... .......... .......... .......... .......... 77% 42.1M 1s 2024-09-14T21:24:57.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130450K .......... .......... .......... .......... .......... 77% 26.6M 1s 2024-09-14T21:24:57.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130500K .......... .......... .......... .......... .......... 77% 30.5M 1s 2024-09-14T21:24:57.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130550K .......... .......... .......... .......... .......... 77% 24.4M 1s 2024-09-14T21:24:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130600K .......... .......... .......... .......... .......... 77% 53.6M 1s 2024-09-14T21:24:57.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130650K .......... .......... .......... .......... .......... 77% 25.4M 1s 2024-09-14T21:24:57.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130700K .......... .......... .......... .......... .......... 77% 31.2M 1s 2024-09-14T21:24:57.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130750K .......... .......... .......... .......... .......... 77% 24.4M 1s 2024-09-14T21:24:57.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130800K .......... .......... .......... .......... .......... 77% 24.1M 1s 2024-09-14T21:24:57.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130850K .......... .......... .......... .......... .......... 77% 26.3M 1s 2024-09-14T21:24:57.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130900K .......... .......... .......... .......... .......... 77% 42.4M 1s 2024-09-14T21:24:57.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:130950K .......... .......... .......... .......... .......... 77% 25.0M 1s 2024-09-14T21:24:57.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131000K .......... .......... .......... .......... .......... 77% 37.2M 1s 2024-09-14T21:24:57.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131050K .......... .......... .......... .......... .......... 77% 24.6M 1s 2024-09-14T21:24:57.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131100K .......... .......... .......... .......... .......... 77% 62.0M 1s 2024-09-14T21:24:57.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131150K .......... .......... .......... .......... .......... 77% 19.5M 1s 2024-09-14T21:24:57.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131200K .......... .......... .......... .......... .......... 77% 29.0M 1s 2024-09-14T21:24:57.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131250K .......... .......... .......... .......... .......... 77% 23.2M 1s 2024-09-14T21:24:57.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131300K .......... .......... .......... .......... .......... 77% 40.3M 1s 2024-09-14T21:24:57.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131350K .......... .......... .......... .......... .......... 77% 22.3M 1s 2024-09-14T21:24:57.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131400K .......... .......... .......... .......... .......... 77% 47.6M 1s 2024-09-14T21:24:57.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131450K .......... .......... .......... .......... .......... 78% 27.1M 1s 2024-09-14T21:24:57.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131500K .......... .......... .......... .......... .......... 78% 31.3M 1s 2024-09-14T21:24:57.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131550K .......... .......... .......... .......... .......... 78% 26.3M 1s 2024-09-14T21:24:57.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131600K .......... .......... .......... .......... .......... 78% 25.9M 1s 2024-09-14T21:24:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131650K .......... .......... .......... .......... .......... 78% 49.6M 1s 2024-09-14T21:24:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131700K .......... .......... .......... .......... .......... 78% 24.6M 1s 2024-09-14T21:24:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131750K .......... .......... .......... .......... .......... 78% 30.9M 1s 2024-09-14T21:24:57.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131800K .......... .......... .......... .......... .......... 78% 35.8M 1s 2024-09-14T21:24:57.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131850K .......... .......... .......... .......... .......... 78% 18.7M 1s 2024-09-14T21:24:57.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131900K .......... .......... .......... .......... .......... 78% 41.2M 1s 2024-09-14T21:24:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:131950K .......... .......... .......... .......... .......... 78% 27.7M 1s 2024-09-14T21:24:57.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132000K .......... .......... .......... .......... .......... 78% 23.6M 1s 2024-09-14T21:24:57.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132050K .......... .......... .......... .......... .......... 78% 34.9M 1s 2024-09-14T21:24:57.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132100K .......... .......... .......... .......... .......... 78% 34.6M 1s 2024-09-14T21:24:57.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132150K .......... .......... .......... .......... .......... 78% 30.1M 1s 2024-09-14T21:24:57.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132200K .......... .......... .......... .......... .......... 78% 26.7M 1s 2024-09-14T21:24:57.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132250K .......... .......... .......... .......... .......... 78% 33.5M 1s 2024-09-14T21:24:57.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132300K .......... .......... .......... .......... .......... 78% 24.3M 1s 2024-09-14T21:24:57.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132350K .......... .......... .......... .......... .......... 78% 22.6M 1s 2024-09-14T21:24:57.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132400K .......... .......... .......... .......... .......... 78% 33.3M 1s 2024-09-14T21:24:57.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132450K .......... .......... .......... .......... .......... 78% 40.4M 1s 2024-09-14T21:24:57.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132500K .......... .......... .......... .......... .......... 78% 22.3M 1s 2024-09-14T21:24:57.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132550K .......... .......... .......... .......... .......... 78% 32.6M 1s 2024-09-14T21:24:57.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132600K .......... .......... .......... .......... .......... 78% 23.9M 1s 2024-09-14T21:24:57.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132650K .......... .......... .......... .......... .......... 78% 56.1M 1s 2024-09-14T21:24:57.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132700K .......... .......... .......... .......... .......... 78% 27.3M 1s 2024-09-14T21:24:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132750K .......... .......... .......... .......... .......... 78% 20.6M 1s 2024-09-14T21:24:57.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132800K .......... .......... .......... .......... .......... 78% 31.8M 1s 2024-09-14T21:24:57.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132850K .......... .......... .......... .......... .......... 78% 28.2M 1s 2024-09-14T21:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132900K .......... .......... .......... .......... .......... 78% 28.4M 1s 2024-09-14T21:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:132950K .......... .......... .......... .......... .......... 78% 40.0M 1s 2024-09-14T21:24:57.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133000K .......... .......... .......... .......... .......... 78% 36.9M 1s 2024-09-14T21:24:57.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133050K .......... .......... .......... .......... .......... 78% 23.8M 1s 2024-09-14T21:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133100K .......... .......... .......... .......... .......... 78% 28.0M 1s 2024-09-14T21:24:57.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133150K .......... .......... .......... .......... .......... 79% 24.1M 1s 2024-09-14T21:24:57.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133200K .......... .......... .......... .......... .......... 79% 47.9M 1s 2024-09-14T21:24:57.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133250K .......... .......... .......... .......... .......... 79% 22.7M 1s 2024-09-14T21:24:57.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133300K .......... .......... .......... .......... .......... 79% 35.4M 1s 2024-09-14T21:24:57.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133350K .......... .......... .......... .......... .......... 79% 23.8M 1s 2024-09-14T21:24:57.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133400K .......... .......... .......... .......... .......... 79% 51.6M 1s 2024-09-14T21:24:57.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133450K .......... .......... .......... .......... .......... 79% 25.3M 1s 2024-09-14T21:24:57.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133500K .......... .......... .......... .......... .......... 79% 39.0M 1s 2024-09-14T21:24:57.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133550K .......... .......... .......... .......... .......... 79% 17.8M 1s 2024-09-14T21:24:57.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133600K .......... .......... .......... .......... .......... 79% 33.8M 1s 2024-09-14T21:24:57.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133650K .......... .......... .......... .......... .......... 79% 25.5M 1s 2024-09-14T21:24:57.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133700K .......... .......... .......... .......... .......... 79% 52.5M 1s 2024-09-14T21:24:57.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133750K .......... .......... .......... .......... .......... 79% 24.0M 1s 2024-09-14T21:24:57.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133800K .......... .......... .......... .......... .......... 79% 33.5M 1s 2024-09-14T21:24:57.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133850K .......... .......... .......... .......... .......... 79% 24.2M 1s 2024-09-14T21:24:57.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133900K .......... .......... .......... .......... .......... 79% 46.4M 1s 2024-09-14T21:24:57.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:133950K .......... .......... .......... .......... .......... 79% 22.7M 1s 2024-09-14T21:24:57.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134000K .......... .......... .......... .......... .......... 79% 26.8M 1s 2024-09-14T21:24:57.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134050K .......... .......... .......... .......... .......... 79% 32.9M 1s 2024-09-14T21:24:57.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134100K .......... .......... .......... .......... .......... 79% 26.5M 1s 2024-09-14T21:24:57.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134150K .......... .......... .......... .......... .......... 79% 23.6M 1s 2024-09-14T21:24:57.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134200K .......... .......... .......... .......... .......... 79% 53.4M 1s 2024-09-14T21:24:57.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134250K .......... .......... .......... .......... .......... 79% 23.3M 1s 2024-09-14T21:24:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134300K .......... .......... .......... .......... .......... 79% 27.1M 1s 2024-09-14T21:24:57.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134350K .......... .......... .......... .......... .......... 79% 30.8M 1s 2024-09-14T21:24:57.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134400K .......... .......... .......... .......... .......... 79% 32.9M 1s 2024-09-14T21:24:57.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134450K .......... .......... .......... .......... .......... 79% 36.3M 1s 2024-09-14T21:24:57.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134500K .......... .......... .......... .......... .......... 79% 22.6M 1s 2024-09-14T21:24:57.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134550K .......... .......... .......... .......... .......... 79% 36.6M 1s 2024-09-14T21:24:57.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134600K .......... .......... .......... .......... .......... 79% 24.4M 1s 2024-09-14T21:24:57.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134650K .......... .......... .......... .......... .......... 79% 23.5M 1s 2024-09-14T21:24:57.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134700K .......... .......... .......... .......... .......... 79% 55.1M 1s 2024-09-14T21:24:57.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134750K .......... .......... .......... .......... .......... 79% 22.9M 1s 2024-09-14T21:24:57.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134800K .......... .......... .......... .......... .......... 79% 24.1M 1s 2024-09-14T21:24:57.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134850K .......... .......... .......... .......... .......... 80% 39.9M 1s 2024-09-14T21:24:57.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134900K .......... .......... .......... .......... .......... 80% 22.5M 1s 2024-09-14T21:24:57.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:134950K .......... .......... .......... .......... .......... 80% 45.6M 1s 2024-09-14T21:24:57.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135000K .......... .......... .......... .......... .......... 80% 26.7M 1s 2024-09-14T21:24:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135050K .......... .......... .......... .......... .......... 80% 32.1M 1s 2024-09-14T21:24:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135100K .......... .......... .......... .......... .......... 80% 33.0M 1s 2024-09-14T21:24:57.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135150K .......... .......... .......... .......... .......... 80% 20.9M 1s 2024-09-14T21:24:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135200K .......... .......... .......... .......... .......... 80% 22.7M 1s 2024-09-14T21:24:57.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135250K .......... .......... .......... .......... .......... 80% 57.0M 1s 2024-09-14T21:24:57.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135300K .......... .......... .......... .......... .......... 80% 23.0M 1s 2024-09-14T21:24:57.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135350K .......... .......... .......... .......... .......... 80% 37.2M 1s 2024-09-14T21:24:57.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135400K .......... .......... .......... .......... .......... 80% 23.3M 1s 2024-09-14T21:24:57.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135450K .......... .......... .......... .......... .......... 80% 43.7M 1s 2024-09-14T21:24:57.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135500K .......... .......... .......... .......... .......... 80% 23.9M 1s 2024-09-14T21:24:57.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135550K .......... .......... .......... .......... .......... 80% 27.8M 1s 2024-09-14T21:24:57.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135600K .......... .......... .......... .......... .......... 80% 23.6M 1s 2024-09-14T21:24:57.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135650K .......... .......... .......... .......... .......... 80% 23.4M 1s 2024-09-14T21:24:57.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135700K .......... .......... .......... .......... .......... 80% 70.1M 1s 2024-09-14T21:24:57.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135750K .......... .......... .......... .......... .......... 80% 20.9M 1s 2024-09-14T21:24:57.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135800K .......... .......... .......... .......... .......... 80% 25.5M 1s 2024-09-14T21:24:57.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135850K .......... .......... .......... .......... .......... 80% 44.4M 1s 2024-09-14T21:24:57.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135900K .......... .......... .......... .......... .......... 80% 38.5M 1s 2024-09-14T21:24:57.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:135950K .......... .......... .......... .......... .......... 80% 21.1M 1s 2024-09-14T21:24:57.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136000K .......... .......... .......... .......... .......... 80% 46.8M 1s 2024-09-14T21:24:57.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136050K .......... .......... .......... .......... .......... 80% 25.2M 1s 2024-09-14T21:24:57.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136100K .......... .......... .......... .......... .......... 80% 39.0M 1s 2024-09-14T21:24:57.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136150K .......... .......... .......... .......... .......... 80% 22.2M 1s 2024-09-14T21:24:57.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136200K .......... .......... .......... .......... .......... 80% 47.9M 1s 2024-09-14T21:24:57.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136250K .......... .......... .......... .......... .......... 80% 25.7M 1s 2024-09-14T21:24:57.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136300K .......... .......... .......... .......... .......... 80% 40.5M 1s 2024-09-14T21:24:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136350K .......... .......... .......... .......... .......... 80% 21.7M 1s 2024-09-14T21:24:57.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136400K .......... .......... .......... .......... .......... 80% 23.3M 1s 2024-09-14T21:24:57.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136450K .......... .......... .......... .......... .......... 80% 28.6M 1s 2024-09-14T21:24:57.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136500K .......... .......... .......... .......... .......... 81% 53.0M 1s 2024-09-14T21:24:57.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136550K .......... .......... .......... .......... .......... 81% 28.9M 1s 2024-09-14T21:24:57.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136600K .......... .......... .......... .......... .......... 81% 25.8M 1s 2024-09-14T21:24:57.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136650K .......... .......... .......... .......... .......... 81% 23.6M 1s 2024-09-14T21:24:57.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136700K .......... .......... .......... .......... .......... 81% 64.8M 1s 2024-09-14T21:24:57.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136750K .......... .......... .......... .......... .......... 81% 21.8M 1s 2024-09-14T21:24:57.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136800K .......... .......... .......... .......... .......... 81% 22.0M 1s 2024-09-14T21:24:57.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136850K .......... .......... .......... .......... .......... 81% 44.3M 1s 2024-09-14T21:24:57.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136900K .......... .......... .......... .......... .......... 81% 25.7M 1s 2024-09-14T21:24:57.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:136950K .......... .......... .......... .......... .......... 81% 22.5M 1s 2024-09-14T21:24:57.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137000K .......... .......... .......... .......... .......... 81% 36.6M 1s 2024-09-14T21:24:57.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137050K .......... .......... .......... .......... .......... 81% 29.1M 1s 2024-09-14T21:24:57.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137100K .......... .......... .......... .......... .......... 81% 35.5M 1s 2024-09-14T21:24:57.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137150K .......... .......... .......... .......... .......... 81% 23.6M 1s 2024-09-14T21:24:57.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137200K .......... .......... .......... .......... .......... 81% 24.9M 1s 2024-09-14T21:24:57.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137250K .......... .......... .......... .......... .......... 81% 48.3M 1s 2024-09-14T21:24:57.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137300K .......... .......... .......... .......... .......... 81% 35.8M 1s 2024-09-14T21:24:57.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137350K .......... .......... .......... .......... .......... 81% 25.4M 1s 2024-09-14T21:24:58.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137400K .......... .......... .......... .......... .......... 81% 23.5M 1s 2024-09-14T21:24:58.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137450K .......... .......... .......... .......... .......... 81% 26.8M 1s 2024-09-14T21:24:58.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137500K .......... .......... .......... .......... .......... 81% 55.7M 1s 2024-09-14T21:24:58.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137550K .......... .......... .......... .......... .......... 81% 21.3M 1s 2024-09-14T21:24:58.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137600K .......... .......... .......... .......... .......... 81% 23.5M 1s 2024-09-14T21:24:58.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137650K .......... .......... .......... .......... .......... 81% 43.4M 1s 2024-09-14T21:24:58.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137700K .......... .......... .......... .......... .......... 81% 25.9M 1s 2024-09-14T21:24:58.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137750K .......... .......... .......... .......... .......... 81% 36.6M 1s 2024-09-14T21:24:58.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137800K .......... .......... .......... .......... .......... 81% 27.3M 1s 2024-09-14T21:24:58.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137850K .......... .......... .......... .......... .......... 81% 36.1M 1s 2024-09-14T21:24:58.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137900K .......... .......... .......... .......... .......... 81% 28.7M 1s 2024-09-14T21:24:58.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:137950K .......... .......... .......... .......... .......... 81% 19.9M 1s 2024-09-14T21:24:58.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138000K .......... .......... .......... .......... .......... 81% 25.2M 1s 2024-09-14T21:24:58.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138050K .......... .......... .......... .......... .......... 81% 54.9M 1s 2024-09-14T21:24:58.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138100K .......... .......... .......... .......... .......... 81% 19.8M 1s 2024-09-14T21:24:58.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138150K .......... .......... .......... .......... .......... 81% 52.2M 1s 2024-09-14T21:24:58.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138200K .......... .......... .......... .......... .......... 82% 22.8M 1s 2024-09-14T21:24:58.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138250K .......... .......... .......... .......... .......... 82% 56.6M 1s 2024-09-14T21:24:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138300K .......... .......... .......... .......... .......... 82% 25.2M 1s 2024-09-14T21:24:58.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138350K .......... .......... .......... .......... .......... 82% 18.3M 1s 2024-09-14T21:24:58.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138400K .......... .......... .......... .......... .......... 82% 30.9M 1s 2024-09-14T21:24:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138450K .......... .......... .......... .......... .......... 82% 27.1M 1s 2024-09-14T21:24:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138500K .......... .......... .......... .......... .......... 82% 58.8M 1s 2024-09-14T21:24:58.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138550K .......... .......... .......... .......... .......... 82% 24.4M 1s 2024-09-14T21:24:58.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138600K .......... .......... .......... .......... .......... 82% 28.2M 1s 2024-09-14T21:24:58.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138650K .......... .......... .......... .......... .......... 82% 28.1M 1s 2024-09-14T21:24:58.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138700K .......... .......... .......... .......... .......... 82% 23.8M 1s 2024-09-14T21:24:58.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138750K .......... .......... .......... .......... .......... 82% 22.7M 1s 2024-09-14T21:24:58.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138800K .......... .......... .......... .......... .......... 82% 61.3M 1s 2024-09-14T21:24:58.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138850K .......... .......... .......... .......... .......... 82% 22.2M 1s 2024-09-14T21:24:58.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138900K .......... .......... .......... .......... .......... 82% 39.8M 1s 2024-09-14T21:24:58.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:138950K .......... .......... .......... .......... .......... 82% 23.7M 1s 2024-09-14T21:24:58.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139000K .......... .......... .......... .......... .......... 82% 39.6M 1s 2024-09-14T21:24:58.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139050K .......... .......... .......... .......... .......... 82% 28.0M 1s 2024-09-14T21:24:58.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139100K .......... .......... .......... .......... .......... 82% 33.7M 1s 2024-09-14T21:24:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139150K .......... .......... .......... .......... .......... 82% 25.6M 1s 2024-09-14T21:24:58.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139200K .......... .......... .......... .......... .......... 82% 24.8M 1s 2024-09-14T21:24:58.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139250K .......... .......... .......... .......... .......... 82% 24.1M 1s 2024-09-14T21:24:58.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139300K .......... .......... .......... .......... .......... 82% 44.4M 1s 2024-09-14T21:24:58.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139350K .......... .......... .......... .......... .......... 82% 30.6M 1s 2024-09-14T21:24:58.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139400K .......... .......... .......... .......... .......... 82% 31.3M 1s 2024-09-14T21:24:58.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139450K .......... .......... .......... .......... .......... 82% 23.5M 1s 2024-09-14T21:24:58.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139500K .......... .......... .......... .......... .......... 82% 41.8M 1s 2024-09-14T21:24:58.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139550K .......... .......... .......... .......... .......... 82% 24.9M 1s 2024-09-14T21:24:58.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139600K .......... .......... .......... .......... .......... 82% 25.2M 1s 2024-09-14T21:24:58.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139650K .......... .......... .......... .......... .......... 82% 39.6M 1s 2024-09-14T21:24:58.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139700K .......... .......... .......... .......... .......... 82% 21.3M 1s 2024-09-14T21:24:58.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139750K .......... .......... .......... .......... .......... 82% 27.0M 1s 2024-09-14T21:24:58.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139800K .......... .......... .......... .......... .......... 82% 51.8M 1s 2024-09-14T21:24:58.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139850K .......... .......... .......... .......... .......... 82% 24.0M 1s 2024-09-14T21:24:58.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139900K .......... .......... .......... .......... .......... 83% 28.4M 1s 2024-09-14T21:24:58.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:139950K .......... .......... .......... .......... .......... 83% 29.9M 1s 2024-09-14T21:24:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140000K .......... .......... .......... .......... .......... 83% 23.0M 1s 2024-09-14T21:24:58.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140050K .......... .......... .......... .......... .......... 83% 49.4M 1s 2024-09-14T21:24:58.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140100K .......... .......... .......... .......... .......... 83% 25.4M 1s 2024-09-14T21:24:58.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140150K .......... .......... .......... .......... .......... 83% 29.3M 1s 2024-09-14T21:24:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140200K .......... .......... .......... .......... .......... 83% 27.7M 1s 2024-09-14T21:24:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140250K .......... .......... .......... .......... .......... 83% 64.4M 1s 2024-09-14T21:24:58.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140300K .......... .......... .......... .......... .......... 83% 22.1M 1s 2024-09-14T21:24:58.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140350K .......... .......... .......... .......... .......... 83% 23.5M 1s 2024-09-14T21:24:58.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140400K .......... .......... .......... .......... .......... 83% 23.6M 1s 2024-09-14T21:24:58.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140450K .......... .......... .......... .......... .......... 83% 40.6M 1s 2024-09-14T21:24:58.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140500K .......... .......... .......... .......... .......... 83% 24.2M 1s 2024-09-14T21:24:58.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140550K .......... .......... .......... .......... .......... 83% 45.0M 1s 2024-09-14T21:24:58.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140600K .......... .......... .......... .......... .......... 83% 22.9M 1s 2024-09-14T21:24:58.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140650K .......... .......... .......... .......... .......... 83% 32.9M 1s 2024-09-14T21:24:58.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140700K .......... .......... .......... .......... .......... 83% 26.1M 1s 2024-09-14T21:24:58.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140750K .......... .......... .......... .......... .......... 83% 27.8M 1s 2024-09-14T21:24:58.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140800K .......... .......... .......... .......... .......... 83% 38.3M 1s 2024-09-14T21:24:58.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140850K .......... .......... .......... .......... .......... 83% 31.2M 1s 2024-09-14T21:24:58.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140900K .......... .......... .......... .......... .......... 83% 20.6M 1s 2024-09-14T21:24:58.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:140950K .......... .......... .......... .......... .......... 83% 29.9M 1s 2024-09-14T21:24:58.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141000K .......... .......... .......... .......... .......... 83% 28.9M 1s 2024-09-14T21:24:58.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141050K .......... .......... .......... .......... .......... 83% 46.6M 1s 2024-09-14T21:24:58.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141100K .......... .......... .......... .......... .......... 83% 26.4M 1s 2024-09-14T21:24:58.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141150K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-09-14T21:24:58.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141200K .......... .......... .......... .......... .......... 83% 37.0M 1s 2024-09-14T21:24:58.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141250K .......... .......... .......... .......... .......... 83% 23.9M 1s 2024-09-14T21:24:58.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141300K .......... .......... .......... .......... .......... 83% 43.3M 1s 2024-09-14T21:24:58.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141350K .......... .......... .......... .......... .......... 83% 24.9M 1s 2024-09-14T21:24:58.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141400K .......... .......... .......... .......... .......... 83% 38.0M 1s 2024-09-14T21:24:58.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141450K .......... .......... .......... .......... .......... 83% 24.9M 1s 2024-09-14T21:24:58.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141500K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-09-14T21:24:58.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141550K .......... .......... .......... .......... .......... 84% 20.9M 1s 2024-09-14T21:24:58.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141600K .......... .......... .......... .......... .......... 84% 68.7M 1s 2024-09-14T21:24:58.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141650K .......... .......... .......... .......... .......... 84% 23.9M 1s 2024-09-14T21:24:58.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141700K .......... .......... .......... .......... .......... 84% 39.1M 1s 2024-09-14T21:24:58.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141750K .......... .......... .......... .......... .......... 84% 24.8M 1s 2024-09-14T21:24:58.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141800K .......... .......... .......... .......... .......... 84% 40.2M 1s 2024-09-14T21:24:58.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141850K .......... .......... .......... .......... .......... 84% 24.2M 1s 2024-09-14T21:24:58.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141900K .......... .......... .......... .......... .......... 84% 41.3M 1s 2024-09-14T21:24:58.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:141950K .......... .......... .......... .......... .......... 84% 25.4M 1s 2024-09-14T21:24:58.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142000K .......... .......... .......... .......... .......... 84% 22.2M 1s 2024-09-14T21:24:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142050K .......... .......... .......... .......... .......... 84% 21.0M 1s 2024-09-14T21:24:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142100K .......... .......... .......... .......... .......... 84% 40.5M 1s 2024-09-14T21:24:58.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142150K .......... .......... .......... .......... .......... 84% 28.1M 1s 2024-09-14T21:24:58.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142200K .......... .......... .......... .......... .......... 84% 26.6M 1s 2024-09-14T21:24:58.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142250K .......... .......... .......... .......... .......... 84% 33.9M 1s 2024-09-14T21:24:58.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142300K .......... .......... .......... .......... .......... 84% 31.0M 1s 2024-09-14T21:24:58.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142350K .......... .......... .......... .......... .......... 84% 30.1M 1s 2024-09-14T21:24:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142400K .......... .......... .......... .......... .......... 84% 25.0M 1s 2024-09-14T21:24:58.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142450K .......... .......... .......... .......... .......... 84% 23.5M 1s 2024-09-14T21:24:58.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142500K .......... .......... .......... .......... .......... 84% 40.8M 1s 2024-09-14T21:24:58.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142550K .......... .......... .......... .......... .......... 84% 29.9M 1s 2024-09-14T21:24:58.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142600K .......... .......... .......... .......... .......... 84% 36.6M 1s 2024-09-14T21:24:58.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142650K .......... .......... .......... .......... .......... 84% 33.9M 1s 2024-09-14T21:24:58.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142700K .......... .......... .......... .......... .......... 84% 22.5M 1s 2024-09-14T21:24:58.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142750K .......... .......... .......... .......... .......... 84% 20.4M 1s 2024-09-14T21:24:58.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142800K .......... .......... .......... .......... .......... 84% 35.1M 1s 2024-09-14T21:24:58.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142850K .......... .......... .......... .......... .......... 84% 46.9M 1s 2024-09-14T21:24:58.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142900K .......... .......... .......... .......... .......... 84% 22.7M 1s 2024-09-14T21:24:58.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:142950K .......... .......... .......... .......... .......... 84% 30.0M 1s 2024-09-14T21:24:58.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143000K .......... .......... .......... .......... .......... 84% 26.3M 1s 2024-09-14T21:24:58.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143050K .......... .......... .......... .......... .......... 84% 63.7M 1s 2024-09-14T21:24:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143100K .......... .......... .......... .......... .......... 84% 21.5M 1s 2024-09-14T21:24:58.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143150K .......... .......... .......... .......... .......... 84% 26.8M 1s 2024-09-14T21:24:58.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143200K .......... .......... .......... .......... .......... 84% 31.7M 1s 2024-09-14T21:24:58.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143250K .......... .......... .......... .......... .......... 85% 24.4M 1s 2024-09-14T21:24:58.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143300K .......... .......... .......... .......... .......... 85% 46.1M 1s 2024-09-14T21:24:58.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143350K .......... .......... .......... .......... .......... 85% 29.4M 1s 2024-09-14T21:24:58.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143400K .......... .......... .......... .......... .......... 85% 22.8M 1s 2024-09-14T21:24:58.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143450K .......... .......... .......... .......... .......... 85% 34.9M 1s 2024-09-14T21:24:58.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143500K .......... .......... .......... .......... .......... 85% 22.5M 1s 2024-09-14T21:24:58.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143550K .......... .......... .......... .......... .......... 85% 26.9M 1s 2024-09-14T21:24:58.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143600K .......... .......... .......... .......... .......... 85% 52.5M 1s 2024-09-14T21:24:58.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143650K .......... .......... .......... .......... .......... 85% 24.3M 1s 2024-09-14T21:24:58.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143700K .......... .......... .......... .......... .......... 85% 36.6M 1s 2024-09-14T21:24:58.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143750K .......... .......... .......... .......... .......... 85% 17.1M 1s 2024-09-14T21:24:58.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143800K .......... .......... .......... .......... .......... 85% 50.9M 1s 2024-09-14T21:24:58.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143850K .......... .......... .......... .......... .......... 85% 36.6M 1s 2024-09-14T21:24:58.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143900K .......... .......... .......... .......... .......... 85% 29.3M 1s 2024-09-14T21:24:58.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:143950K .......... .......... .......... .......... .......... 85% 20.2M 1s 2024-09-14T21:24:58.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144000K .......... .......... .......... .......... .......... 85% 37.1M 1s 2024-09-14T21:24:58.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144050K .......... .......... .......... .......... .......... 85% 24.0M 1s 2024-09-14T21:24:58.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144100K .......... .......... .......... .......... .......... 85% 44.3M 1s 2024-09-14T21:24:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144150K .......... .......... .......... .......... .......... 85% 23.5M 1s 2024-09-14T21:24:58.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144200K .......... .......... .......... .......... .......... 85% 35.8M 1s 2024-09-14T21:24:58.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144250K .......... .......... .......... .......... .......... 85% 19.1M 1s 2024-09-14T21:24:58.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144300K .......... .......... .......... .......... .......... 85% 23.7M 1s 2024-09-14T21:24:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144350K .......... .......... .......... .......... .......... 85% 28.7M 1s 2024-09-14T21:24:58.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144400K .......... .......... .......... .......... .......... 85% 41.5M 1s 2024-09-14T21:24:58.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144450K .......... .......... .......... .......... .......... 85% 30.0M 1s 2024-09-14T21:24:58.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144500K .......... .......... .......... .......... .......... 85% 54.5M 1s 2024-09-14T21:24:58.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144550K .......... .......... .......... .......... .......... 85% 25.2M 1s 2024-09-14T21:24:58.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144600K .......... .......... .......... .......... .......... 85% 45.9M 1s 2024-09-14T21:24:58.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144650K .......... .......... .......... .......... .......... 85% 25.4M 1s 2024-09-14T21:24:58.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144700K .......... .......... .......... .......... .......... 85% 35.3M 1s 2024-09-14T21:24:58.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144750K .......... .......... .......... .......... .......... 85% 24.9M 1s 2024-09-14T21:24:58.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144800K .......... .......... .......... .......... .......... 85% 23.3M 1s 2024-09-14T21:24:58.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144850K .......... .......... .......... .......... .......... 85% 24.4M 1s 2024-09-14T21:24:58.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144900K .......... .......... .......... .......... .......... 85% 38.5M 1s 2024-09-14T21:24:58.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:144950K .......... .......... .......... .......... .......... 86% 28.4M 1s 2024-09-14T21:24:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145000K .......... .......... .......... .......... .......... 86% 36.3M 1s 2024-09-14T21:24:58.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145050K .......... .......... .......... .......... .......... 86% 26.0M 1s 2024-09-14T21:24:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145100K .......... .......... .......... .......... .......... 86% 37.0M 1s 2024-09-14T21:24:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145150K .......... .......... .......... .......... .......... 86% 23.8M 1s 2024-09-14T21:24:58.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145200K .......... .......... .......... .......... .......... 86% 26.9M 1s 2024-09-14T21:24:58.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145250K .......... .......... .......... .......... .......... 86% 35.9M 1s 2024-09-14T21:24:58.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145300K .......... .......... .......... .......... .......... 86% 25.4M 1s 2024-09-14T21:24:58.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145350K .......... .......... .......... .......... .......... 86% 18.7M 1s 2024-09-14T21:24:58.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145400K .......... .......... .......... .......... .......... 86% 41.0M 1s 2024-09-14T21:24:58.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145450K .......... .......... .......... .......... .......... 86% 36.9M 1s 2024-09-14T21:24:58.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145500K .......... .......... .......... .......... .......... 86% 37.2M 1s 2024-09-14T21:24:58.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145550K .......... .......... .......... .......... .......... 86% 24.3M 1s 2024-09-14T21:24:58.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145600K .......... .......... .......... .......... .......... 86% 21.2M 1s 2024-09-14T21:24:58.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145650K .......... .......... .......... .......... .......... 86% 35.5M 1s 2024-09-14T21:24:58.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145700K .......... .......... .......... .......... .......... 86% 29.5M 1s 2024-09-14T21:24:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145750K .......... .......... .......... .......... .......... 86% 30.0M 1s 2024-09-14T21:24:58.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145800K .......... .......... .......... .......... .......... 86% 35.6M 1s 2024-09-14T21:24:58.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145850K .......... .......... .......... .......... .......... 86% 38.9M 1s 2024-09-14T21:24:58.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145900K .......... .......... .......... .......... .......... 86% 25.7M 1s 2024-09-14T21:24:58.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:145950K .......... .......... .......... .......... .......... 86% 25.5M 1s 2024-09-14T21:24:58.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146000K .......... .......... .......... .......... .......... 86% 31.8M 1s 2024-09-14T21:24:58.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146050K .......... .......... .......... .......... .......... 86% 24.8M 1s 2024-09-14T21:24:58.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146100K .......... .......... .......... .......... .......... 86% 25.1M 1s 2024-09-14T21:24:58.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146150K .......... .......... .......... .......... .......... 86% 45.9M 1s 2024-09-14T21:24:58.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146200K .......... .......... .......... .......... .......... 86% 26.3M 1s 2024-09-14T21:24:58.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146250K .......... .......... .......... .......... .......... 86% 36.3M 1s 2024-09-14T21:24:58.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146300K .......... .......... .......... .......... .......... 86% 21.6M 1s 2024-09-14T21:24:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146350K .......... .......... .......... .......... .......... 86% 26.3M 1s 2024-09-14T21:24:58.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146400K .......... .......... .......... .......... .......... 86% 43.1M 1s 2024-09-14T21:24:58.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146450K .......... .......... .......... .......... .......... 86% 25.9M 1s 2024-09-14T21:24:58.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146500K .......... .......... .......... .......... .......... 86% 44.2M 1s 2024-09-14T21:24:58.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146550K .......... .......... .......... .......... .......... 86% 21.4M 1s 2024-09-14T21:24:58.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146600K .......... .......... .......... .......... .......... 86% 25.3M 1s 2024-09-14T21:24:58.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146650K .......... .......... .......... .......... .......... 87% 55.4M 1s 2024-09-14T21:24:58.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146700K .......... .......... .......... .......... .......... 87% 24.0M 1s 2024-09-14T21:24:58.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146750K .......... .......... .......... .......... .......... 87% 23.4M 1s 2024-09-14T21:24:58.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146800K .......... .......... .......... .......... .......... 87% 35.8M 1s 2024-09-14T21:24:58.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146850K .......... .......... .......... .......... .......... 87% 23.1M 1s 2024-09-14T21:24:58.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146900K .......... .......... .......... .......... .......... 87% 46.8M 1s 2024-09-14T21:24:58.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:146950K .......... .......... .......... .......... .......... 87% 28.4M 1s 2024-09-14T21:24:58.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147000K .......... .......... .......... .......... .......... 87% 30.7M 1s 2024-09-14T21:24:58.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147050K .......... .......... .......... .......... .......... 87% 27.6M 1s 2024-09-14T21:24:58.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147100K .......... .......... .......... .......... .......... 87% 23.3M 1s 2024-09-14T21:24:58.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147150K .......... .......... .......... .......... .......... 87% 21.5M 1s 2024-09-14T21:24:58.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147200K .......... .......... .......... .......... .......... 87% 67.5M 1s 2024-09-14T21:24:58.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147250K .......... .......... .......... .......... .......... 87% 23.4M 1s 2024-09-14T21:24:58.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147300K .......... .......... .......... .......... .......... 87% 36.5M 1s 2024-09-14T21:24:58.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147350K .......... .......... .......... .......... .......... 87% 25.1M 1s 2024-09-14T21:24:58.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147400K .......... .......... .......... .......... .......... 87% 46.6M 1s 2024-09-14T21:24:58.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147450K .......... .......... .......... .......... .......... 87% 23.0M 1s 2024-09-14T21:24:58.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147500K .......... .......... .......... .......... .......... 87% 12.9M 1s 2024-09-14T21:24:58.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147550K .......... .......... .......... .......... .......... 87% 89.7M 1s 2024-09-14T21:24:58.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147600K .......... .......... .......... .......... .......... 87% 33.7M 1s 2024-09-14T21:24:58.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147650K .......... .......... .......... .......... .......... 87% 18.1M 1s 2024-09-14T21:24:58.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147700K .......... .......... .......... .......... .......... 87% 59.0M 1s 2024-09-14T21:24:58.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147750K .......... .......... .......... .......... .......... 87% 29.0M 1s 2024-09-14T21:24:58.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147800K .......... .......... .......... .......... .......... 87% 25.7M 1s 2024-09-14T21:24:58.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147850K .......... .......... .......... .......... .......... 87% 33.0M 1s 2024-09-14T21:24:58.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147900K .......... .......... .......... .......... .......... 87% 42.2M 1s 2024-09-14T21:24:58.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:147950K .......... .......... .......... .......... .......... 87% 29.7M 1s 2024-09-14T21:24:58.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148000K .......... .......... .......... .......... .......... 87% 26.1M 1s 2024-09-14T21:24:58.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148050K .......... .......... .......... .......... .......... 87% 33.3M 1s 2024-09-14T21:24:58.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148100K .......... .......... .......... .......... .......... 87% 33.7M 1s 2024-09-14T21:24:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148150K .......... .......... .......... .......... .......... 87% 56.3M 1s 2024-09-14T21:24:58.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148200K .......... .......... .......... .......... .......... 87% 23.0M 1s 2024-09-14T21:24:58.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148250K .......... .......... .......... .......... .......... 87% 21.5M 1s 2024-09-14T21:24:58.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148300K .......... .......... .......... .......... .......... 88% 40.0M 1s 2024-09-14T21:24:58.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148350K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-09-14T21:24:58.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148400K .......... .......... .......... .......... .......... 88% 26.8M 1s 2024-09-14T21:24:58.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148450K .......... .......... .......... .......... .......... 88% 45.8M 1s 2024-09-14T21:24:58.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148500K .......... .......... .......... .......... .......... 88% 25.8M 1s 2024-09-14T21:24:58.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148550K .......... .......... .......... .......... .......... 88% 31.4M 1s 2024-09-14T21:24:58.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148600K .......... .......... .......... .......... .......... 88% 21.9M 1s 2024-09-14T21:24:58.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148650K .......... .......... .......... .......... .......... 88% 83.3M 1s 2024-09-14T21:24:58.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148700K .......... .......... .......... .......... .......... 88% 27.6M 1s 2024-09-14T21:24:58.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148750K .......... .......... .......... .......... .......... 88% 22.1M 1s 2024-09-14T21:24:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148800K .......... .......... .......... .......... .......... 88% 33.7M 1s 2024-09-14T21:24:58.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148850K .......... .......... .......... .......... .......... 88% 23.2M 1s 2024-09-14T21:24:58.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148900K .......... .......... .......... .......... .......... 88% 28.1M 1s 2024-09-14T21:24:58.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:148950K .......... .......... .......... .......... .......... 88% 50.2M 1s 2024-09-14T21:24:58.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149000K .......... .......... .......... .......... .......... 88% 22.8M 1s 2024-09-14T21:24:58.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149050K .......... .......... .......... .......... .......... 88% 32.9M 1s 2024-09-14T21:24:58.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149100K .......... .......... .......... .......... .......... 88% 23.9M 1s 2024-09-14T21:24:58.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149150K .......... .......... .......... .......... .......... 88% 27.4M 1s 2024-09-14T21:24:58.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149200K .......... .......... .......... .......... .......... 88% 47.9M 1s 2024-09-14T21:24:58.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149250K .......... .......... .......... .......... .......... 88% 25.4M 1s 2024-09-14T21:24:58.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149300K .......... .......... .......... .......... .......... 88% 35.7M 1s 2024-09-14T21:24:58.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149350K .......... .......... .......... .......... .......... 88% 21.6M 1s 2024-09-14T21:24:58.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149400K .......... .......... .......... .......... .......... 88% 23.5M 1s 2024-09-14T21:24:58.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149450K .......... .......... .......... .......... .......... 88% 113M 1s 2024-09-14T21:24:58.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149500K .......... .......... .......... .......... .......... 88% 23.1M 1s 2024-09-14T21:24:58.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149550K .......... .......... .......... .......... .......... 88% 32.5M 1s 2024-09-14T21:24:58.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149600K .......... .......... .......... .......... .......... 88% 21.3M 1s 2024-09-14T21:24:58.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149650K .......... .......... .......... .......... .......... 88% 29.3M 1s 2024-09-14T21:24:58.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149700K .......... .......... .......... .......... .......... 88% 44.4M 1s 2024-09-14T21:24:58.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149750K .......... .......... .......... .......... .......... 88% 23.0M 1s 2024-09-14T21:24:58.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149800K .......... .......... .......... .......... .......... 88% 36.6M 1s 2024-09-14T21:24:58.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149850K .......... .......... .......... .......... .......... 88% 21.7M 1s 2024-09-14T21:24:58.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149900K .......... .......... .......... .......... .......... 88% 34.0M 1s 2024-09-14T21:24:58.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:149950K .......... .......... .......... .......... .......... 88% 20.0M 1s 2024-09-14T21:24:58.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150000K .......... .......... .......... .......... .......... 89% 59.3M 1s 2024-09-14T21:24:58.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150050K .......... .......... .......... .......... .......... 89% 23.3M 1s 2024-09-14T21:24:58.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150100K .......... .......... .......... .......... .......... 89% 33.6M 1s 2024-09-14T21:24:58.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150150K .......... .......... .......... .......... .......... 89% 26.8M 1s 2024-09-14T21:24:58.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150200K .......... .......... .......... .......... .......... 89% 39.1M 1s 2024-09-14T21:24:58.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150250K .......... .......... .......... .......... .......... 89% 26.1M 1s 2024-09-14T21:24:58.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150300K .......... .......... .......... .......... .......... 89% 38.8M 1s 2024-09-14T21:24:58.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150350K .......... .......... .......... .......... .......... 89% 24.5M 1s 2024-09-14T21:24:58.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150400K .......... .......... .......... .......... .......... 89% 29.3M 1s 2024-09-14T21:24:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150450K .......... .......... .......... .......... .......... 89% 19.1M 1s 2024-09-14T21:24:58.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150500K .......... .......... .......... .......... .......... 89% 62.0M 1s 2024-09-14T21:24:58.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150550K .......... .......... .......... .......... .......... 89% 22.8M 1s 2024-09-14T21:24:58.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150600K .......... .......... .......... .......... .......... 89% 31.1M 1s 2024-09-14T21:24:58.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150650K .......... .......... .......... .......... .......... 89% 25.8M 1s 2024-09-14T21:24:58.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150700K .......... .......... .......... .......... .......... 89% 47.3M 1s 2024-09-14T21:24:58.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150750K .......... .......... .......... .......... .......... 89% 24.3M 1s 2024-09-14T21:24:58.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150800K .......... .......... .......... .......... .......... 89% 24.8M 1s 2024-09-14T21:24:58.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150850K .......... .......... .......... .......... .......... 89% 25.2M 1s 2024-09-14T21:24:58.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150900K .......... .......... .......... .......... .......... 89% 32.9M 1s 2024-09-14T21:24:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:150950K .......... .......... .......... .......... .......... 89% 37.9M 1s 2024-09-14T21:24:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151000K .......... .......... .......... .......... .......... 89% 47.9M 1s 2024-09-14T21:24:58.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151050K .......... .......... .......... .......... .......... 89% 25.5M 1s 2024-09-14T21:24:58.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151100K .......... .......... .......... .......... .......... 89% 22.8M 1s 2024-09-14T21:24:58.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151150K .......... .......... .......... .......... .......... 89% 22.4M 1s 2024-09-14T21:24:58.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151200K .......... .......... .......... .......... .......... 89% 27.1M 1s 2024-09-14T21:24:58.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151250K .......... .......... .......... .......... .......... 89% 37.7M 1s 2024-09-14T21:24:58.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151300K .......... .......... .......... .......... .......... 89% 32.0M 1s 2024-09-14T21:24:58.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151350K .......... .......... .......... .......... .......... 89% 32.1M 1s 2024-09-14T21:24:58.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151400K .......... .......... .......... .......... .......... 89% 24.3M 1s 2024-09-14T21:24:58.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151450K .......... .......... .......... .......... .......... 89% 59.7M 1s 2024-09-14T21:24:58.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151500K .......... .......... .......... .......... .......... 89% 25.5M 1s 2024-09-14T21:24:58.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151550K .......... .......... .......... .......... .......... 89% 23.7M 1s 2024-09-14T21:24:58.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151600K .......... .......... .......... .......... .......... 89% 30.1M 1s 2024-09-14T21:24:58.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151650K .......... .......... .......... .......... .......... 89% 22.8M 1s 2024-09-14T21:24:58.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151700K .......... .......... .......... .......... .......... 90% 26.9M 1s 2024-09-14T21:24:58.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151750K .......... .......... .......... .......... .......... 90% 45.6M 1s 2024-09-14T21:24:58.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151800K .......... .......... .......... .......... .......... 90% 25.8M 1s 2024-09-14T21:24:58.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151850K .......... .......... .......... .......... .......... 90% 37.9M 1s 2024-09-14T21:24:58.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151900K .......... .......... .......... .......... .......... 90% 33.2M 1s 2024-09-14T21:24:58.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:151950K .......... .......... .......... .......... .......... 90% 18.3M 1s 2024-09-14T21:24:58.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152000K .......... .......... .......... .......... .......... 90% 59.2M 1s 2024-09-14T21:24:58.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152050K .......... .......... .......... .......... .......... 90% 23.2M 1s 2024-09-14T21:24:58.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152100K .......... .......... .......... .......... .......... 90% 34.5M 1s 2024-09-14T21:24:58.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152150K .......... .......... .......... .......... .......... 90% 24.2M 1s 2024-09-14T21:24:58.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152200K .......... .......... .......... .......... .......... 90% 22.8M 1s 2024-09-14T21:24:58.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152250K .......... .......... .......... .......... .......... 90% 67.7M 1s 2024-09-14T21:24:58.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152300K .......... .......... .......... .......... .......... 90% 22.6M 1s 2024-09-14T21:24:58.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152350K .......... .......... .......... .......... .......... 90% 24.7M 1s 2024-09-14T21:24:58.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152400K .......... .......... .......... .......... .......... 90% 35.6M 1s 2024-09-14T21:24:58.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152450K .......... .......... .......... .......... .......... 90% 24.5M 1s 2024-09-14T21:24:58.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152500K .......... .......... .......... .......... .......... 90% 53.4M 1s 2024-09-14T21:24:58.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152550K .......... .......... .......... .......... .......... 90% 24.9M 1s 2024-09-14T21:24:58.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152600K .......... .......... .......... .......... .......... 90% 32.9M 1s 2024-09-14T21:24:58.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152650K .......... .......... .......... .......... .......... 90% 23.6M 1s 2024-09-14T21:24:58.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152700K .......... .......... .......... .......... .......... 90% 66.6M 1s 2024-09-14T21:24:58.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152750K .......... .......... .......... .......... .......... 90% 15.1M 1s 2024-09-14T21:24:58.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152800K .......... .......... .......... .......... .......... 90% 52.2M 1s 2024-09-14T21:24:58.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152850K .......... .......... .......... .......... .......... 90% 20.7M 1s 2024-09-14T21:24:58.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152900K .......... .......... .......... .......... .......... 90% 44.1M 1s 2024-09-14T21:24:58.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:152950K .......... .......... .......... .......... .......... 90% 24.0M 1s 2024-09-14T21:24:58.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153000K .......... .......... .......... .......... .......... 90% 50.2M 1s 2024-09-14T21:24:58.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153050K .......... .......... .......... .......... .......... 90% 22.5M 1s 2024-09-14T21:24:58.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153100K .......... .......... .......... .......... .......... 90% 38.8M 1s 2024-09-14T21:24:58.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153150K .......... .......... .......... .......... .......... 90% 25.8M 1s 2024-09-14T21:24:58.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153200K .......... .......... .......... .......... .......... 90% 24.8M 1s 2024-09-14T21:24:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153250K .......... .......... .......... .......... .......... 90% 50.8M 1s 2024-09-14T21:24:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153300K .......... .......... .......... .......... .......... 90% 22.8M 1s 2024-09-14T21:24:58.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153350K .......... .......... .......... .......... .......... 91% 35.0M 1s 2024-09-14T21:24:58.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153400K .......... .......... .......... .......... .......... 91% 26.1M 1s 2024-09-14T21:24:58.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153450K .......... .......... .......... .......... .......... 91% 22.7M 1s 2024-09-14T21:24:58.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153500K .......... .......... .......... .......... .......... 91% 56.6M 1s 2024-09-14T21:24:58.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153550K .......... .......... .......... .......... .......... 91% 22.1M 1s 2024-09-14T21:24:58.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153600K .......... .......... .......... .......... .......... 91% 24.6M 1s 2024-09-14T21:24:58.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153650K .......... .......... .......... .......... .......... 91% 41.5M 1s 2024-09-14T21:24:58.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153700K .......... .......... .......... .......... .......... 91% 23.9M 1s 2024-09-14T21:24:58.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153750K .......... .......... .......... .......... .......... 91% 36.2M 1s 2024-09-14T21:24:58.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153800K .......... .......... .......... .......... .......... 91% 29.2M 1s 2024-09-14T21:24:58.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153850K .......... .......... .......... .......... .......... 91% 36.0M 1s 2024-09-14T21:24:58.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153900K .......... .......... .......... .......... .......... 91% 35.4M 0s 2024-09-14T21:24:58.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:153950K .......... .......... .......... .......... .......... 91% 21.1M 0s 2024-09-14T21:24:58.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154000K .......... .......... .......... .......... .......... 91% 20.2M 0s 2024-09-14T21:24:58.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154050K .......... .......... .......... .......... .......... 91% 47.8M 0s 2024-09-14T21:24:58.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154100K .......... .......... .......... .......... .......... 91% 25.0M 0s 2024-09-14T21:24:58.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154150K .......... .......... .......... .......... .......... 91% 33.4M 0s 2024-09-14T21:24:58.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154200K .......... .......... .......... .......... .......... 91% 30.6M 0s 2024-09-14T21:24:58.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154250K .......... .......... .......... .......... .......... 91% 38.7M 0s 2024-09-14T21:24:58.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154300K .......... .......... .......... .......... .......... 91% 24.6M 0s 2024-09-14T21:24:58.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154350K .......... .......... .......... .......... .......... 91% 23.3M 0s 2024-09-14T21:24:58.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154400K .......... .......... .......... .......... .......... 91% 36.2M 0s 2024-09-14T21:24:58.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154450K .......... .......... .......... .......... .......... 91% 30.6M 0s 2024-09-14T21:24:58.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154500K .......... .......... .......... .......... .......... 91% 22.9M 0s 2024-09-14T21:24:58.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154550K .......... .......... .......... .......... .......... 91% 37.9M 0s 2024-09-14T21:24:58.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154600K .......... .......... .......... .......... .......... 91% 24.4M 0s 2024-09-14T21:24:58.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154650K .......... .......... .......... .......... .......... 91% 37.6M 0s 2024-09-14T21:24:58.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154700K .......... .......... .......... .......... .......... 91% 22.6M 0s 2024-09-14T21:24:58.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154750K .......... .......... .......... .......... .......... 91% 38.4M 0s 2024-09-14T21:24:58.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154800K .......... .......... .......... .......... .......... 91% 29.0M 0s 2024-09-14T21:24:58.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154850K .......... .......... .......... .......... .......... 91% 23.3M 0s 2024-09-14T21:24:58.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154900K .......... .......... .......... .......... .......... 91% 42.1M 0s 2024-09-14T21:24:58.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:154950K .......... .......... .......... .......... .......... 91% 31.4M 0s 2024-09-14T21:24:58.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155000K .......... .......... .......... .......... .......... 91% 29.9M 0s 2024-09-14T21:24:58.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155050K .......... .......... .......... .......... .......... 92% 27.5M 0s 2024-09-14T21:24:58.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155100K .......... .......... .......... .......... .......... 92% 30.6M 0s 2024-09-14T21:24:58.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155150K .......... .......... .......... .......... .......... 92% 17.7M 0s 2024-09-14T21:24:58.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155200K .......... .......... .......... .......... .......... 92% 42.6M 0s 2024-09-14T21:24:58.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155250K .......... .......... .......... .......... .......... 92% 37.5M 0s 2024-09-14T21:24:58.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155300K .......... .......... .......... .......... .......... 92% 32.7M 0s 2024-09-14T21:24:58.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155350K .......... .......... .......... .......... .......... 92% 27.9M 0s 2024-09-14T21:24:58.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155400K .......... .......... .......... .......... .......... 92% 23.3M 0s 2024-09-14T21:24:58.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155450K .......... .......... .......... .......... .......... 92% 25.5M 0s 2024-09-14T21:24:58.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155500K .......... .......... .......... .......... .......... 92% 48.5M 0s 2024-09-14T21:24:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155550K .......... .......... .......... .......... .......... 92% 19.2M 0s 2024-09-14T21:24:58.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155600K .......... .......... .......... .......... .......... 92% 36.8M 0s 2024-09-14T21:24:58.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155650K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-09-14T21:24:58.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155700K .......... .......... .......... .......... .......... 92% 48.0M 0s 2024-09-14T21:24:58.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155750K .......... .......... .......... .......... .......... 92% 20.5M 0s 2024-09-14T21:24:58.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155800K .......... .......... .......... .......... .......... 92% 55.3M 0s 2024-09-14T21:24:58.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155850K .......... .......... .......... .......... .......... 92% 32.0M 0s 2024-09-14T21:24:58.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155900K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-09-14T21:24:58.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:155950K .......... .......... .......... .......... .......... 92% 26.8M 0s 2024-09-14T21:24:58.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156000K .......... .......... .......... .......... .......... 92% 22.2M 0s 2024-09-14T21:24:58.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156050K .......... .......... .......... .......... .......... 92% 66.9M 0s 2024-09-14T21:24:58.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156100K .......... .......... .......... .......... .......... 92% 30.6M 0s 2024-09-14T21:24:58.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156150K .......... .......... .......... .......... .......... 92% 26.6M 0s 2024-09-14T21:24:58.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156200K .......... .......... .......... .......... .......... 92% 23.2M 0s 2024-09-14T21:24:58.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156250K .......... .......... .......... .......... .......... 92% 21.7M 0s 2024-09-14T21:24:58.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156300K .......... .......... .......... .......... .......... 92% 73.4M 0s 2024-09-14T21:24:58.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156350K .......... .......... .......... .......... .......... 92% 23.6M 0s 2024-09-14T21:24:58.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156400K .......... .......... .......... .......... .......... 92% 29.5M 0s 2024-09-14T21:24:58.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156450K .......... .......... .......... .......... .......... 92% 32.5M 0s 2024-09-14T21:24:58.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156500K .......... .......... .......... .......... .......... 92% 19.8M 0s 2024-09-14T21:24:58.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156550K .......... .......... .......... .......... .......... 92% 59.3M 0s 2024-09-14T21:24:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156600K .......... .......... .......... .......... .......... 92% 24.4M 0s 2024-09-14T21:24:58.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156650K .......... .......... .......... .......... .......... 92% 34.1M 0s 2024-09-14T21:24:58.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156700K .......... .......... .......... .......... .......... 92% 26.1M 0s 2024-09-14T21:24:58.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156750K .......... .......... .......... .......... .......... 93% 24.7M 0s 2024-09-14T21:24:58.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156800K .......... .......... .......... .......... .......... 93% 23.0M 0s 2024-09-14T21:24:58.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156850K .......... .......... .......... .......... .......... 93% 48.5M 0s 2024-09-14T21:24:58.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156900K .......... .......... .......... .......... .......... 93% 27.4M 0s 2024-09-14T21:24:58.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:156950K .......... .......... .......... .......... .......... 93% 31.7M 0s 2024-09-14T21:24:58.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157000K .......... .......... .......... .......... .......... 93% 25.5M 0s 2024-09-14T21:24:58.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157050K .......... .......... .......... .......... .......... 93% 48.5M 0s 2024-09-14T21:24:58.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157100K .......... .......... .......... .......... .......... 93% 24.6M 0s 2024-09-14T21:24:58.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157150K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-09-14T21:24:58.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157200K .......... .......... .......... .......... .......... 93% 40.4M 0s 2024-09-14T21:24:58.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157250K .......... .......... .......... .......... .......... 93% 22.8M 0s 2024-09-14T21:24:58.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157300K .......... .......... .......... .......... .......... 93% 24.3M 0s 2024-09-14T21:24:58.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157350K .......... .......... .......... .......... .......... 93% 56.2M 0s 2024-09-14T21:24:58.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157400K .......... .......... .......... .......... .......... 93% 23.0M 0s 2024-09-14T21:24:58.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157450K .......... .......... .......... .......... .......... 93% 37.5M 0s 2024-09-14T21:24:58.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157500K .......... .......... .......... .......... .......... 93% 23.7M 0s 2024-09-14T21:24:58.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157550K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-09-14T21:24:58.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157600K .......... .......... .......... .......... .......... 93% 54.0M 0s 2024-09-14T21:24:58.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157650K .......... .......... .......... .......... .......... 93% 25.8M 0s 2024-09-14T21:24:58.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157700K .......... .......... .......... .......... .......... 93% 25.8M 0s 2024-09-14T21:24:58.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157750K .......... .......... .......... .......... .......... 93% 24.4M 0s 2024-09-14T21:24:58.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157800K .......... .......... .......... .......... .......... 93% 49.5M 0s 2024-09-14T21:24:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157850K .......... .......... .......... .......... .......... 93% 24.8M 0s 2024-09-14T21:24:58.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157900K .......... .......... .......... .......... .......... 93% 22.5M 0s 2024-09-14T21:24:58.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:157950K .......... .......... .......... .......... .......... 93% 25.1M 0s 2024-09-14T21:24:58.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158000K .......... .......... .......... .......... .......... 93% 32.9M 0s 2024-09-14T21:24:58.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158050K .......... .......... .......... .......... .......... 93% 27.1M 0s 2024-09-14T21:24:58.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158100K .......... .......... .......... .......... .......... 93% 48.3M 0s 2024-09-14T21:24:58.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158150K .......... .......... .......... .......... .......... 93% 24.3M 0s 2024-09-14T21:24:58.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158200K .......... .......... .......... .......... .......... 93% 22.8M 0s 2024-09-14T21:24:58.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158250K .......... .......... .......... .......... .......... 93% 42.1M 0s 2024-09-14T21:24:58.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158300K .......... .......... .......... .......... .......... 93% 49.1M 0s 2024-09-14T21:24:58.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158350K .......... .......... .......... .......... .......... 93% 24.7M 0s 2024-09-14T21:24:58.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158400K .......... .......... .......... .......... .......... 93% 23.7M 0s 2024-09-14T21:24:58.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158450K .......... .......... .......... .......... .......... 94% 22.8M 0s 2024-09-14T21:24:58.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158500K .......... .......... .......... .......... .......... 94% 38.3M 0s 2024-09-14T21:24:58.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158550K .......... .......... .......... .......... .......... 94% 24.5M 0s 2024-09-14T21:24:58.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158600K .......... .......... .......... .......... .......... 94% 47.3M 0s 2024-09-14T21:24:58.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158650K .......... .......... .......... .......... .......... 94% 23.8M 0s 2024-09-14T21:24:58.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158700K .......... .......... .......... .......... .......... 94% 31.7M 0s 2024-09-14T21:24:58.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158750K .......... .......... .......... .......... .......... 94% 23.5M 0s 2024-09-14T21:24:58.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158800K .......... .......... .......... .......... .......... 94% 21.7M 0s 2024-09-14T21:24:58.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158850K .......... .......... .......... .......... .......... 94% 43.8M 0s 2024-09-14T21:24:58.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158900K .......... .......... .......... .......... .......... 94% 38.4M 0s 2024-09-14T21:24:58.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:158950K .......... .......... .......... .......... .......... 94% 31.4M 0s 2024-09-14T21:24:58.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159000K .......... .......... .......... .......... .......... 94% 22.2M 0s 2024-09-14T21:24:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159050K .......... .......... .......... .......... .......... 94% 26.2M 0s 2024-09-14T21:24:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159100K .......... .......... .......... .......... .......... 94% 71.3M 0s 2024-09-14T21:24:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159150K .......... .......... .......... .......... .......... 94% 20.4M 0s 2024-09-14T21:24:58.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159200K .......... .......... .......... .......... .......... 94% 28.0M 0s 2024-09-14T21:24:58.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159250K .......... .......... .......... .......... .......... 94% 36.6M 0s 2024-09-14T21:24:58.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159300K .......... .......... .......... .......... .......... 94% 25.2M 0s 2024-09-14T21:24:58.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159350K .......... .......... .......... .......... .......... 94% 44.3M 0s 2024-09-14T21:24:58.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159400K .......... .......... .......... .......... .......... 94% 22.0M 0s 2024-09-14T21:24:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159450K .......... .......... .......... .......... .......... 94% 49.0M 0s 2024-09-14T21:24:58.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159500K .......... .......... .......... .......... .......... 94% 24.8M 0s 2024-09-14T21:24:58.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159550K .......... .......... .......... .......... .......... 94% 19.7M 0s 2024-09-14T21:24:58.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159600K .......... .......... .......... .......... .......... 94% 30.1M 0s 2024-09-14T21:24:58.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159650K .......... .......... .......... .......... .......... 94% 35.3M 0s 2024-09-14T21:24:58.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159700K .......... .......... .......... .......... .......... 94% 34.2M 0s 2024-09-14T21:24:58.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159750K .......... .......... .......... .......... .......... 94% 29.5M 0s 2024-09-14T21:24:58.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159800K .......... .......... .......... .......... .......... 94% 25.5M 0s 2024-09-14T21:24:58.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159850K .......... .......... .......... .......... .......... 94% 49.5M 0s 2024-09-14T21:24:58.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159900K .......... .......... .......... .......... .......... 94% 24.6M 0s 2024-09-14T21:24:58.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:159950K .......... .......... .......... .......... .......... 94% 22.4M 0s 2024-09-14T21:24:58.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160000K .......... .......... .......... .......... .......... 94% 42.2M 0s 2024-09-14T21:24:58.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160050K .......... .......... .......... .......... .......... 94% 25.2M 0s 2024-09-14T21:24:58.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160100K .......... .......... .......... .......... .......... 95% 20.5M 0s 2024-09-14T21:24:58.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160150K .......... .......... .......... .......... .......... 95% 65.8M 0s 2024-09-14T21:24:58.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160200K .......... .......... .......... .......... .......... 95% 21.2M 0s 2024-09-14T21:24:58.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160250K .......... .......... .......... .......... .......... 95% 44.7M 0s 2024-09-14T21:24:58.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160300K .......... .......... .......... .......... .......... 95% 22.7M 0s 2024-09-14T21:24:58.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160350K .......... .......... .......... .......... .......... 95% 23.6M 0s 2024-09-14T21:24:58.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160400K .......... .......... .......... .......... .......... 95% 65.3M 0s 2024-09-14T21:24:58.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160450K .......... .......... .......... .......... .......... 95% 23.7M 0s 2024-09-14T21:24:58.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160500K .......... .......... .......... .......... .......... 95% 37.4M 0s 2024-09-14T21:24:58.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160550K .......... .......... .......... .......... .......... 95% 24.7M 0s 2024-09-14T21:24:58.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160600K .......... .......... .......... .......... .......... 95% 46.2M 0s 2024-09-14T21:24:58.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160650K .......... .......... .......... .......... .......... 95% 23.5M 0s 2024-09-14T21:24:58.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160700K .......... .......... .......... .......... .......... 95% 43.9M 0s 2024-09-14T21:24:58.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160750K .......... .......... .......... .......... .......... 95% 20.5M 0s 2024-09-14T21:24:58.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160800K .......... .......... .......... .......... .......... 95% 21.7M 0s 2024-09-14T21:24:58.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160850K .......... .......... .......... .......... .......... 95% 30.6M 0s 2024-09-14T21:24:58.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160900K .......... .......... .......... .......... .......... 95% 42.9M 0s 2024-09-14T21:24:58.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:160950K .......... .......... .......... .......... .......... 95% 35.7M 0s 2024-09-14T21:24:58.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161000K .......... .......... .......... .......... .......... 95% 28.1M 0s 2024-09-14T21:24:58.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161050K .......... .......... .......... .......... .......... 95% 24.1M 0s 2024-09-14T21:24:58.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161100K .......... .......... .......... .......... .......... 95% 45.1M 0s 2024-09-14T21:24:58.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161150K .......... .......... .......... .......... .......... 95% 19.5M 0s 2024-09-14T21:24:58.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161200K .......... .......... .......... .......... .......... 95% 27.8M 0s 2024-09-14T21:24:58.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161250K .......... .......... .......... .......... .......... 95% 30.6M 0s 2024-09-14T21:24:58.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161300K .......... .......... .......... .......... .......... 95% 30.5M 0s 2024-09-14T21:24:58.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161350K .......... .......... .......... .......... .......... 95% 20.9M 0s 2024-09-14T21:24:58.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161400K .......... .......... .......... .......... .......... 95% 68.3M 0s 2024-09-14T21:24:58.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161450K .......... .......... .......... .......... .......... 95% 24.6M 0s 2024-09-14T21:24:58.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161500K .......... .......... .......... .......... .......... 95% 34.7M 0s 2024-09-14T21:24:58.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161550K .......... .......... .......... .......... .......... 95% 23.4M 0s 2024-09-14T21:24:58.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161600K .......... .......... .......... .......... .......... 95% 24.6M 0s 2024-09-14T21:24:58.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161650K .......... .......... .......... .......... .......... 95% 45.3M 0s 2024-09-14T21:24:58.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161700K .......... .......... .......... .......... .......... 95% 23.9M 0s 2024-09-14T21:24:58.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161750K .......... .......... .......... .......... .......... 95% 36.8M 0s 2024-09-14T21:24:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161800K .......... .......... .......... .......... .......... 96% 22.9M 0s 2024-09-14T21:24:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161850K .......... .......... .......... .......... .......... 96% 24.1M 0s 2024-09-14T21:24:58.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161900K .......... .......... .......... .......... .......... 96% 110M 0s 2024-09-14T21:24:58.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:161950K .......... .......... .......... .......... .......... 96% 18.1M 0s 2024-09-14T21:24:58.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162000K .......... .......... .......... .......... .......... 96% 24.2M 0s 2024-09-14T21:24:58.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162050K .......... .......... .......... .......... .......... 96% 49.5M 0s 2024-09-14T21:24:58.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162100K .......... .......... .......... .......... .......... 96% 31.2M 0s 2024-09-14T21:24:58.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162150K .......... .......... .......... .......... .......... 96% 28.3M 0s 2024-09-14T21:24:58.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162200K .......... .......... .......... .......... .......... 96% 25.4M 0s 2024-09-14T21:24:58.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162250K .......... .......... .......... .......... .......... 96% 37.4M 0s 2024-09-14T21:24:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162300K .......... .......... .......... .......... .......... 96% 24.5M 0s 2024-09-14T21:24:58.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162350K .......... .......... .......... .......... .......... 96% 22.2M 0s 2024-09-14T21:24:58.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162400K .......... .......... .......... .......... .......... 96% 28.3M 0s 2024-09-14T21:24:58.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162450K .......... .......... .......... .......... .......... 96% 49.5M 0s 2024-09-14T21:24:58.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162500K .......... .......... .......... .......... .......... 96% 34.9M 0s 2024-09-14T21:24:58.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162550K .......... .......... .......... .......... .......... 96% 21.5M 0s 2024-09-14T21:24:58.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162600K .......... .......... .......... .......... .......... 96% 27.8M 0s 2024-09-14T21:24:58.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162650K .......... .......... .......... .......... .......... 96% 43.8M 0s 2024-09-14T21:24:58.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162700K .......... .......... .......... .......... .......... 96% 25.5M 0s 2024-09-14T21:24:58.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162750K .......... .......... .......... .......... .......... 96% 27.8M 0s 2024-09-14T21:24:58.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162800K .......... .......... .......... .......... .......... 96% 31.5M 0s 2024-09-14T21:24:58.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162850K .......... .......... .......... .......... .......... 96% 22.8M 0s 2024-09-14T21:24:58.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162900K .......... .......... .......... .......... .......... 96% 24.0M 0s 2024-09-14T21:24:58.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:162950K .......... .......... .......... .......... .......... 96% 48.3M 0s 2024-09-14T21:24:58.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163000K .......... .......... .......... .......... .......... 96% 37.6M 0s 2024-09-14T21:24:58.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163050K .......... .......... .......... .......... .......... 96% 31.2M 0s 2024-09-14T21:24:58.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163100K .......... .......... .......... .......... .......... 96% 18.8M 0s 2024-09-14T21:24:58.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163150K .......... .......... .......... .......... .......... 96% 26.3M 0s 2024-09-14T21:24:58.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163200K .......... .......... .......... .......... .......... 96% 32.3M 0s 2024-09-14T21:24:58.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163250K .......... .......... .......... .......... .......... 96% 29.1M 0s 2024-09-14T21:24:58.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163300K .......... .......... .......... .......... .......... 96% 30.1M 0s 2024-09-14T21:24:58.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163350K .......... .......... .......... .......... .......... 96% 28.9M 0s 2024-09-14T21:24:58.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163400K .......... .......... .......... .......... .......... 96% 47.1M 0s 2024-09-14T21:24:58.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163450K .......... .......... .......... .......... .......... 96% 28.9M 0s 2024-09-14T21:24:58.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163500K .......... .......... .......... .......... .......... 97% 31.9M 0s 2024-09-14T21:24:58.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163550K .......... .......... .......... .......... .......... 97% 27.5M 0s 2024-09-14T21:24:58.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163600K .......... .......... .......... .......... .......... 97% 24.4M 0s 2024-09-14T21:24:58.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163650K .......... .......... .......... .......... .......... 97% 21.2M 0s 2024-09-14T21:24:58.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163700K .......... .......... .......... .......... .......... 97% 52.2M 0s 2024-09-14T21:24:58.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163750K .......... .......... .......... .......... .......... 97% 25.9M 0s 2024-09-14T21:24:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163800K .......... .......... .......... .......... .......... 97% 34.8M 0s 2024-09-14T21:24:58.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163850K .......... .......... .......... .......... .......... 97% 25.3M 0s 2024-09-14T21:24:58.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163900K .......... .......... .......... .......... .......... 97% 55.4M 0s 2024-09-14T21:24:58.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:163950K .......... .......... .......... .......... .......... 97% 23.0M 0s 2024-09-14T21:24:58.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164000K .......... .......... .......... .......... .......... 97% 24.2M 0s 2024-09-14T21:24:58.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164050K .......... .......... .......... .......... .......... 97% 35.6M 0s 2024-09-14T21:24:58.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164100K .......... .......... .......... .......... .......... 97% 22.7M 0s 2024-09-14T21:24:58.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164150K .......... .......... .......... .......... .......... 97% 26.9M 0s 2024-09-14T21:24:58.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164200K .......... .......... .......... .......... .......... 97% 38.9M 0s 2024-09-14T21:24:58.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164250K .......... .......... .......... .......... .......... 97% 24.6M 0s 2024-09-14T21:24:58.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164300K .......... .......... .......... .......... .......... 97% 39.3M 0s 2024-09-14T21:24:58.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164350K .......... .......... .......... .......... .......... 97% 26.4M 0s 2024-09-14T21:24:58.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164400K .......... .......... .......... .......... .......... 97% 23.1M 0s 2024-09-14T21:24:58.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164450K .......... .......... .......... .......... .......... 97% 71.1M 0s 2024-09-14T21:24:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164500K .......... .......... .......... .......... .......... 97% 22.8M 0s 2024-09-14T21:24:58.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164550K .......... .......... .......... .......... .......... 97% 33.8M 0s 2024-09-14T21:24:58.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164600K .......... .......... .......... .......... .......... 97% 25.4M 0s 2024-09-14T21:24:58.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164650K .......... .......... .......... .......... .......... 97% 21.1M 0s 2024-09-14T21:24:58.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164700K .......... .......... .......... .......... .......... 97% 56.2M 0s 2024-09-14T21:24:58.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164750K .......... .......... .......... .......... .......... 97% 24.7M 0s 2024-09-14T21:24:58.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164800K .......... .......... .......... .......... .......... 97% 25.1M 0s 2024-09-14T21:24:58.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164850K .......... .......... .......... .......... .......... 97% 34.0M 0s 2024-09-14T21:24:58.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164900K .......... .......... .......... .......... .......... 97% 25.7M 0s 2024-09-14T21:24:58.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:164950K .......... .......... .......... .......... .......... 97% 50.9M 0s 2024-09-14T21:24:58.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165000K .......... .......... .......... .......... .......... 97% 23.6M 0s 2024-09-14T21:24:58.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165050K .......... .......... .......... .......... .......... 97% 39.8M 0s 2024-09-14T21:24:58.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165100K .......... .......... .......... .......... .......... 97% 24.8M 0s 2024-09-14T21:24:58.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165150K .......... .......... .......... .......... .......... 98% 19.9M 0s 2024-09-14T21:24:58.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165200K .......... .......... .......... .......... .......... 98% 26.4M 0s 2024-09-14T21:24:58.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165250K .......... .......... .......... .......... .......... 98% 37.6M 0s 2024-09-14T21:24:58.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165300K .......... .......... .......... .......... .......... 98% 29.5M 0s 2024-09-14T21:24:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165350K .......... .......... .......... .......... .......... 98% 34.5M 0s 2024-09-14T21:24:58.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165400K .......... .......... .......... .......... .......... 98% 24.4M 0s 2024-09-14T21:24:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165450K .......... .......... .......... .......... .......... 98% 48.7M 0s 2024-09-14T21:24:58.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165500K .......... .......... .......... .......... .......... 98% 22.1M 0s 2024-09-14T21:24:58.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165550K .......... .......... .......... .......... .......... 98% 23.8M 0s 2024-09-14T21:24:58.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165600K .......... .......... .......... .......... .......... 98% 46.2M 0s 2024-09-14T21:24:58.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165650K .......... .......... .......... .......... .......... 98% 23.9M 0s 2024-09-14T21:24:58.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165700K .......... .......... .......... .......... .......... 98% 47.7M 0s 2024-09-14T21:24:58.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165750K .......... .......... .......... .......... .......... 98% 23.3M 0s 2024-09-14T21:24:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165800K .......... .......... .......... .......... .......... 98% 37.7M 0s 2024-09-14T21:24:58.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165850K .......... .......... .......... .......... .......... 98% 20.5M 0s 2024-09-14T21:24:58.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165900K .......... .......... .......... .......... .......... 98% 30.4M 0s 2024-09-14T21:24:58.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:165950K .......... .......... .......... .......... .......... 98% 23.4M 0s 2024-09-14T21:24:58.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166000K .......... .......... .......... .......... .......... 98% 52.0M 0s 2024-09-14T21:24:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166050K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-09-14T21:24:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166100K .......... .......... .......... .......... .......... 98% 38.1M 0s 2024-09-14T21:24:58.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166150K .......... .......... .......... .......... .......... 98% 23.0M 0s 2024-09-14T21:24:58.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166200K .......... .......... .......... .......... .......... 98% 42.3M 0s 2024-09-14T21:24:58.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166250K .......... .......... .......... .......... .......... 98% 25.7M 0s 2024-09-14T21:24:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166300K .......... .......... .......... .......... .......... 98% 37.6M 0s 2024-09-14T21:24:58.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166350K .......... .......... .......... .......... .......... 98% 25.0M 0s 2024-09-14T21:24:58.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166400K .......... .......... .......... .......... .......... 98% 24.3M 0s 2024-09-14T21:24:58.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166450K .......... .......... .......... .......... .......... 98% 24.2M 0s 2024-09-14T21:24:58.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166500K .......... .......... .......... .......... .......... 98% 47.9M 0s 2024-09-14T21:24:58.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166550K .......... .......... .......... .......... .......... 98% 23.0M 0s 2024-09-14T21:24:58.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166600K .......... .......... .......... .......... .......... 98% 30.7M 0s 2024-09-14T21:24:58.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166650K .......... .......... .......... .......... .......... 98% 24.8M 0s 2024-09-14T21:24:58.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166700K .......... .......... .......... .......... .......... 98% 86.5M 0s 2024-09-14T21:24:58.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166750K .......... .......... .......... .......... .......... 98% 19.8M 0s 2024-09-14T21:24:58.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166800K .......... .......... .......... .......... .......... 98% 28.8M 0s 2024-09-14T21:24:58.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166850K .......... .......... .......... .......... .......... 99% 22.9M 0s 2024-09-14T21:24:58.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166900K .......... .......... .......... .......... .......... 99% 86.5M 0s 2024-09-14T21:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:166950K .......... .......... .......... .......... .......... 99% 18.3M 0s 2024-09-14T21:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167000K .......... .......... .......... .......... .......... 99% 43.8M 0s 2024-09-14T21:24:58.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167050K .......... .......... .......... .......... .......... 99% 26.2M 0s 2024-09-14T21:24:59.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167100K .......... .......... .......... .......... .......... 99% 29.3M 0s 2024-09-14T21:24:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167150K .......... .......... .......... .......... .......... 99% 26.9M 0s 2024-09-14T21:24:59.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167200K .......... .......... .......... .......... .......... 99% 25.1M 0s 2024-09-14T21:24:59.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167250K .......... .......... .......... .......... .......... 99% 52.0M 0s 2024-09-14T21:24:59.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167300K .......... .......... .......... .......... .......... 99% 24.3M 0s 2024-09-14T21:24:59.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167350K .......... .......... .......... .......... .......... 99% 23.5M 0s 2024-09-14T21:24:59.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167400K .......... .......... .......... .......... .......... 99% 38.0M 0s 2024-09-14T21:24:59.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167450K .......... .......... .......... .......... .......... 99% 24.8M 0s 2024-09-14T21:24:59.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167500K .......... .......... .......... .......... .......... 99% 38.4M 0s 2024-09-14T21:24:59.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167550K .......... .......... .......... .......... .......... 99% 29.9M 0s 2024-09-14T21:24:59.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167600K .......... .......... .......... .......... .......... 99% 27.7M 0s 2024-09-14T21:24:59.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167650K .......... .......... .......... .......... .......... 99% 28.6M 0s 2024-09-14T21:24:59.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167700K .......... .......... .......... .......... .......... 99% 23.7M 0s 2024-09-14T21:24:59.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167750K .......... .......... .......... .......... .......... 99% 38.2M 0s 2024-09-14T21:24:59.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167800K .......... .......... .......... .......... .......... 99% 28.2M 0s 2024-09-14T21:24:59.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167850K .......... .......... .......... .......... .......... 99% 24.1M 0s 2024-09-14T21:24:59.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167900K .......... .......... .......... .......... .......... 99% 75.4M 0s 2024-09-14T21:24:59.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:167950K .......... .......... .......... .......... .......... 99% 17.4M 0s 2024-09-14T21:24:59.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168000K .......... .......... .......... .......... .......... 99% 17.3M 0s 2024-09-14T21:24:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168050K .......... .......... .......... .......... .......... 99% 151M 0s 2024-09-14T21:24:59.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168100K .......... .......... .......... .......... .......... 99% 34.4M 0s 2024-09-14T21:24:59.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168150K .......... .......... .......... .......... .......... 99% 27.3M 0s 2024-09-14T21:24:59.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168200K .......... .......... .......... .......... .......... 99% 23.5M 0s 2024-09-14T21:24:59.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168250K .......... .......... .......... .......... .......... 99% 60.6M 0s 2024-09-14T21:24:59.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168300K .......... .......... .......... .......... .......... 99% 23.9M 0s 2024-09-14T21:24:59.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168350K .......... .......... .......... .......... .......... 99% 24.7M 0s 2024-09-14T21:24:59.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168400K .......... .......... .......... .......... .......... 99% 39.0M 0s 2024-09-14T21:24:59.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168450K .......... .......... .......... .......... .......... 99% 22.4M 0s 2024-09-14T21:24:59.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168500K .......... .......... .......... .......... .......... 99% 54.3M 0s 2024-09-14T21:24:59.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:168550K .......... .......... . 100% 36.5M=5.8s 2024-09-14T21:24:59.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:59.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:2024-09-14 21:24:59 (28.6 MB/s) - ‘linux-5.4.tar.gz’ saved [172616875/172616875] 2024-09-14T21:24:59.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: 2024-09-14T21:24:59.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T21:24:59.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T21:24:59.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:24:59.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:24:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:24:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T21:25:00.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:00.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 108b432f6b1d 2024-09-14T21:25:00.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.108b432f6b1d 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:24:59 2024 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:24:59 2024 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:24:59 2024 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:25:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:00.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:00.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:00.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T21:25:00.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T21:25:00.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:00.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T21:25:00.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:00.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:00.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:00.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 17b1ddea-cecd-414b-bd39-6e37a0a24d42 2024-09-14T21:25:00.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:00.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:00.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:00.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:00.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:00.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:00.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:00.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:00.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T21:25:00.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T21:25:00.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:00.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T21:25:00.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:00.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T21:25:00.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:00.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:00.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:00.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:00.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:00.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:00.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:00.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:00.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:01.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:01.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:01.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:01.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T21:25:01.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 4 2024-09-14T21:25:01.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:01.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:01.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T21:25:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:02.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 109bdb717afd 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.109bdb717afd 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:01 2024 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:01 2024 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:01 2024 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:25:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:02.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:02.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:02.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T21:25:02.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T21:25:02.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:02.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T21:25:02.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 6734a41b-a374-442d-8943-4fd7a4ab9dcd 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:02.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:02.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:02.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:02.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T21:25:02.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T21:25:02.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:02.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T21:25:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T21:25:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:25:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:02.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T21:25:02.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:02.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T21:25:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T21:25:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T21:25:02.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:02.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T21:25:03.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:03.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 6 2024-09-14T21:25:03.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:03.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 10b67ceb5974 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.10b67ceb5974 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:03.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:02 2024 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:02 2024 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:02 2024 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:25:03.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:03.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:03.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:03.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T21:25:03.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T21:25:03.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:03.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T21:25:03.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 170144c2-dbb6-4c39-b532-070fba1bc1dc 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:03.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:03.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:03.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T21:25:03.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T21:25:03.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:03.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T21:25:03.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T21:25:03.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:03.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:03.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:03.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:03.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T21:25:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T21:25:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:04.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:04.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 8 2024-09-14T21:25:04.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T21:25:04.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 10c5b2905b83 2024-09-14T21:25:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.10c5b2905b83 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:03 2024 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:03 2024 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:03 2024 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:25:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:04.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:04.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:04.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T21:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T21:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T21:25:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:04.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:04.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:04.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: a3dc01a5-b7ce-4414-b8b1-895278994512 2024-09-14T21:25:04.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:04.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:04.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:04.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:04.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:04.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:04.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:04.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:04.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T21:25:04.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T21:25:04.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:04.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:04.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T21:25:04.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:04.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T21:25:05.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:05.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 11 2024-09-14T21:25:05.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 10 2024-09-14T21:25:05.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:05.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T21:25:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 10d7996920b9 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.10d7996920b9 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:05.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:04 2024 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:04 2024 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:04 2024 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:25:05.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T21:25:05.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T21:25:05.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:05.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T21:25:05.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: a922e5ff-24da-4f3e-9a51-b7df86522fc4 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:05.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:05.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:05.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:05.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T21:25:05.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T21:25:05.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:05.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:05.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:05.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:05.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:05.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:05.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T21:25:06.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:06.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T21:25:06.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:06.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:06.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:06.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 13 2024-09-14T21:25:06.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:06.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T21:25:06.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 10e68756371b 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.10e68756371b 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:05 2024 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:05 2024 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:05 2024 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:06.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:25:06.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:06.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:06.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T21:25:06.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T21:25:06.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:06.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T21:25:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 7e9445fd-555f-47b5-85bc-0e9c49001f96 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:06.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:06.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:06.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:06.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T21:25:06.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T21:25:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:06.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:06.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T21:25:06.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:06.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T21:25:06.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:06.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T21:25:07.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:07.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:07.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:07.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:07.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:07.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 15 2024-09-14T21:25:07.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 16 2024-09-14T21:25:07.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:07.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:07.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T21:25:07.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 10f7d77d1954 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.10f7d77d1954 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:06 2024 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:06 2024 2024-09-14T21:25:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:06 2024 2024-09-14T21:25:07.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:07.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:07.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:25:07.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:07.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:07.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:07.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T21:25:07.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T21:25:07.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:07.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T21:25:07.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:07.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:07.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:07.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 34335381-e8bc-474a-a2b5-2c334b9466d3 2024-09-14T21:25:07.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:07.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:07.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:07.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:07.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:07.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:07.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:07.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:07.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T21:25:07.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T21:25:07.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:07.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:07.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:07.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T21:25:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T21:25:07.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:07.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T21:25:08.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:08.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 19 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 18 2024-09-14T21:25:08.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T21:25:08.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:08.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:08.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1109cb4afe32 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1109cb4afe32 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:08.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:07 2024 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:07 2024 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:07 2024 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:25:08.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:08.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:08.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:08.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T21:25:08.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T21:25:08.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:08.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T21:25:08.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:08.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 611ba3fa-74f5-4b01-a419-1cdd4436b169 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:08.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:08.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:08.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:08.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:08.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T21:25:08.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T21:25:08.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:08.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:08.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:08.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:08.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:08.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:08.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:08.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T21:25:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:08.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T21:25:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T21:25:09.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:09.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:09.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:09.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 21 2024-09-14T21:25:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 23 2024-09-14T21:25:09.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 22 2024-09-14T21:25:09.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:09.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:09.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:09.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T21:25:09.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 111eb91aa7d3 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.111eb91aa7d3 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:09.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:08 2024 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:08 2024 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:08 2024 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:25:09.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:09.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:09.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:09.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T21:25:09.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T21:25:09.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:09.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T21:25:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:09.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: e8f1717d-b8e3-4faf-954b-8698ddf87553 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:09.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:09.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:09.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:09.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T21:25:09.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T21:25:09.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:09.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T21:25:09.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:09.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T21:25:09.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:25:09.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:25:09.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:25:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:25:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T21:25:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:25:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:25:09.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T21:25:10.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:10.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T21:25:10.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:25:10.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 26 2024-09-14T21:25:10.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 25 2024-09-14T21:25:10.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:10.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:10.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:10.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:10.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:10.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:10.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:10.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:10.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 112ff1da57d1 2024-09-14T21:25:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.112ff1da57d1 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:25:09 2024 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:25:09 2024 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:25:09 2024 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:25:10.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:25:10.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:25:10.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:25:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T21:25:10.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T21:25:10.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:25:10.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T21:25:10.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 10d02667-5cba-4e7c-8907-a2a218100745 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:25:10.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:25:10.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:25:10.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:25:10.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:25:10.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T21:25:10.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T21:25:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:25:10.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T21:25:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:25:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35487 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T21:25:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T21:25:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T21:25:10.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:25:10.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:11.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:11.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 29 2024-09-14T21:25:11.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 28 2024-09-14T21:25:11.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 30 2024-09-14T21:25:11.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:11.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:11.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 32 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:12.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 31 2024-09-14T21:25:12.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:12.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:12.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:12.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:12.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:12.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:12.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:12.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:12.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:13.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 33 2024-09-14T21:25:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 35 2024-09-14T21:25:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 34 2024-09-14T21:25:13.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:13.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:13.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 36 2024-09-14T21:25:14.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 37 2024-09-14T21:25:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:14.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:14.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:14.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:14.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:14.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:14.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:14.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:15.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:15.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:15.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:15.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:15.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:15.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:15.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:15.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:15.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:15.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:15.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:15.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 38 2024-09-14T21:25:15.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 40 2024-09-14T21:25:15.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 39 2024-09-14T21:25:15.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:15.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:16.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 41 2024-09-14T21:25:16.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 42 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:16.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:16.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:16.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:16.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:16.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:16.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:16.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:16.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:16.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:16.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:17.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:17.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:17.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:17.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:17.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:17.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:17.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 44 2024-09-14T21:25:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 43 2024-09-14T21:25:17.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 45 2024-09-14T21:25:17.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:17.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:17.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:18.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 47 2024-09-14T21:25:18.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:18.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 46 2024-09-14T21:25:18.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:18.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:18.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:18.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:18.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:18.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:18.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:18.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:18.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:19.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:19.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 50 2024-09-14T21:25:19.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:19.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:19.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:19.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:19.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:19.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:19.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 49 2024-09-14T21:25:19.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 48 2024-09-14T21:25:19.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:19.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:19.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 51 2024-09-14T21:25:20.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 52 2024-09-14T21:25:20.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:20.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:20.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:20.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:20.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:20.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:20.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:20.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:20.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:20.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:21.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:21.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:21.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:21.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:21.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:21.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:21.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 54 2024-09-14T21:25:21.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:21.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:21.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:21.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:21.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:21.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:21.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:21.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 53 2024-09-14T21:25:21.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:22.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 55 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:22.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 56 2024-09-14T21:25:22.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:22.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 57 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:22.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:22.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:22.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:23.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 60 2024-09-14T21:25:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:23.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:23.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:23.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:23.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 59 2024-09-14T21:25:23.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:23.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:24.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:24.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 58 2024-09-14T21:25:24.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:24.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:24.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 61 2024-09-14T21:25:24.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 62 2024-09-14T21:25:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:25.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:25.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 63 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:25.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:25.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:25.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:26.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:26.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 64 2024-09-14T21:25:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 66 2024-09-14T21:25:26.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:27.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 67 2024-09-14T21:25:27.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 65 2024-09-14T21:25:27.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 68 2024-09-14T21:25:27.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:27.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:27.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:27.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:27.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:27.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:27.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:27.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:27.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:28.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:28.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:29.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 69 2024-09-14T21:25:29.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:29.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:30.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 71 2024-09-14T21:25:30.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 70 2024-09-14T21:25:30.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:30.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:30.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:30.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:30.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:30.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:30.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:30.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:30.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:30.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:30.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:31.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 73 2024-09-14T21:25:31.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 72 2024-09-14T21:25:31.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:31.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:32.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 75 2024-09-14T21:25:32.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 74 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:32.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:32.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:33.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 76 2024-09-14T21:25:33.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 78 2024-09-14T21:25:33.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 77 2024-09-14T21:25:33.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:33.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:33.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:33.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:33.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:33.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:33.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:33.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:33.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:33.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:33.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 79 2024-09-14T21:25:33.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 80 2024-09-14T21:25:34.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 81 2024-09-14T21:25:34.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:34.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:35.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 82 2024-09-14T21:25:35.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 83 2024-09-14T21:25:35.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:35.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:35.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:36.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 85 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 84 2024-09-14T21:25:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:36.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:36.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:37.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 89 2024-09-14T21:25:37.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 87 2024-09-14T21:25:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:37.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 86 2024-09-14T21:25:37.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:37.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:37.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:37.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:37.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:37.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:37.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:37.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:37.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:38.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:39.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 88 2024-09-14T21:25:39.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:39.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:39.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:39.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:39.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:39.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:39.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 91 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:40.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 90 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:40.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:40.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:40.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:40.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:40.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:41.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 92 2024-09-14T21:25:41.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 93 2024-09-14T21:25:41.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:41.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:42.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 94 2024-09-14T21:25:42.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 95 2024-09-14T21:25:42.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:42.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:42.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:43.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 96 2024-09-14T21:25:43.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 98 2024-09-14T21:25:43.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 97 2024-09-14T21:25:43.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:43.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:43.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:43.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:43.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:43.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:43.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:43.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:43.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:43.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:43.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 99 2024-09-14T21:25:43.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:44.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 101 2024-09-14T21:25:44.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 100 2024-09-14T21:25:44.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:44.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:44.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:45.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:45.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:45.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:45.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:45.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:45.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:45.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:45.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 103 2024-09-14T21:25:45.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:45.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 102 2024-09-14T21:25:45.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:46.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 104 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:46.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 105 2024-09-14T21:25:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:46.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:46.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:46.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:46.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:47.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 108 2024-09-14T21:25:47.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 107 2024-09-14T21:25:47.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:47.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 106 2024-09-14T21:25:47.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:47.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:48.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:48.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:48.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:48.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:49.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 109 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:49.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:49.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:49.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:49.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:49.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:49.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:49.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:49.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:50.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:50.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:50.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:50.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:50.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:50.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:50.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:50.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:50.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 111 2024-09-14T21:25:50.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 110 2024-09-14T21:25:50.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:50.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:51.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 113 2024-09-14T21:25:51.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 112 2024-09-14T21:25:51.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:51.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:52.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 115 2024-09-14T21:25:52.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 114 2024-09-14T21:25:52.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:52.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:52.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:52.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:52.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:52.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:52.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:53.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 117 2024-09-14T21:25:53.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 116 2024-09-14T21:25:53.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:53.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 119 2024-09-14T21:25:53.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:53.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:53.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:53.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:53.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:53.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:53.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:53.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 118 2024-09-14T21:25:53.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:53.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:54.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 120 2024-09-14T21:25:54.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 121 2024-09-14T21:25:54.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:54.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:54.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:54.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:55.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 122 2024-09-14T21:25:55.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 123 2024-09-14T21:25:55.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:55.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:56.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:56.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:25:56.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:56.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:56.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:25:56.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:25:56.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:25:56.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 125 2024-09-14T21:25:56.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 124 2024-09-14T21:25:56.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:56.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:56.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:56.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:25:56.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:56.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:56.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:25:56.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:25:56.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:25:57.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 129 2024-09-14T21:25:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 126 2024-09-14T21:25:57.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 128 2024-09-14T21:25:57.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:57.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:57.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:57.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:57.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:25:57.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:57.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:57.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:25:57.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:25:57.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:25:58.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:58.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:25:58.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:58.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:58.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:25:58.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:25:58.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:58.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:25:58.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:58.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:25:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:25:59.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 127 2024-09-14T21:25:59.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:25:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:25:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:25:59.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:00.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:00.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:00.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:00.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:00.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:00.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:00.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:00.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 130 2024-09-14T21:26:00.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 131 2024-09-14T21:26:00.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:00.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:01.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 133 2024-09-14T21:26:01.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 132 2024-09-14T21:26:01.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:01.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:01.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 135 2024-09-14T21:26:01.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 134 2024-09-14T21:26:01.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:01.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:02.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:02.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 137 2024-09-14T21:26:02.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 136 2024-09-14T21:26:02.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 138 2024-09-14T21:26:02.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:02.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:02.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:03.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 139 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:03.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:03.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:03.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:03.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:03.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:03.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:03.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:03.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:04.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 141 2024-09-14T21:26:04.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 140 2024-09-14T21:26:04.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:04.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:04.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:04.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:04.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:04.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:04.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:04.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:04.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:04.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:04.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:04.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:04.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:04.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:04.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:04.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:04.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:04.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:04.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:04.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:05.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:05.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 143 2024-09-14T21:26:05.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 145 2024-09-14T21:26:05.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:05.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:06.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 144 2024-09-14T21:26:06.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:06.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 142 2024-09-14T21:26:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:06.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:07.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 146 2024-09-14T21:26:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 147 2024-09-14T21:26:07.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:07.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 148 2024-09-14T21:26:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:07.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:07.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:07.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:07.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:07.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:07.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:07.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:08.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:08.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:09.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 149 2024-09-14T21:26:09.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:09.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 151 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:09.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 150 2024-09-14T21:26:09.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:09.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:10.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:10.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:10.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:10.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:10.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 153 2024-09-14T21:26:10.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 152 2024-09-14T21:26:10.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:10.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:11.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 154 2024-09-14T21:26:11.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 155 2024-09-14T21:26:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:11.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:12.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 156 2024-09-14T21:26:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 158 2024-09-14T21:26:12.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:12.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 157 2024-09-14T21:26:12.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:12.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:12.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:12.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:12.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:12.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:13.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 159 2024-09-14T21:26:13.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:13.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:13.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:13.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:13.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:13.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:13.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:13.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:13.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:13.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:13.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:14.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:14.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:14.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:14.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:14.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:14.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:15.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:15.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:15.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 160 2024-09-14T21:26:15.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 161 2024-09-14T21:26:15.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:15.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 162 2024-09-14T21:26:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:16.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 163 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:16.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 164 2024-09-14T21:26:16.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:16.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 165 2024-09-14T21:26:16.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:16.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:17.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 166 2024-09-14T21:26:17.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 168 2024-09-14T21:26:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:17.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:17.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 167 2024-09-14T21:26:17.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:18.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:18.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:18.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:18.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:18.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:18.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:18.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:18.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:19.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 169 2024-09-14T21:26:19.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:19.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 170 2024-09-14T21:26:19.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 171 2024-09-14T21:26:19.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:19.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:19.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:19.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:19.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:19.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:19.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:19.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:19.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:20.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 173 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:20.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:20.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:21.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 172 2024-09-14T21:26:21.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:22.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 174 2024-09-14T21:26:22.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:22.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:22.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:22.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:22.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:22.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:22.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 175 2024-09-14T21:26:22.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:22.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:22.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:22.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:22.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:22.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:22.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:22.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:22.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:22.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:22.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:22.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:22.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:22.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:23.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 177 2024-09-14T21:26:23.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 178 2024-09-14T21:26:23.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 176 2024-09-14T21:26:23.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:23.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:23.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:23.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:23.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:23.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:23.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:23.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:23.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:23.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 179 2024-09-14T21:26:23.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:24.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:25.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 181 2024-09-14T21:26:25.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 180 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:25.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:25.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:25.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:25.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:25.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 183 2024-09-14T21:26:25.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:26.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 182 2024-09-14T21:26:26.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:26.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:26.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:26.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 185 2024-09-14T21:26:26.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 184 2024-09-14T21:26:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:26.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:26.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:27.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 187 2024-09-14T21:26:27.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 188 2024-09-14T21:26:27.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 186 2024-09-14T21:26:27.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:27.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:27.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:28.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:28.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:28.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:28.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:28.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:28.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:28.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:29.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 189 2024-09-14T21:26:29.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:29.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:29.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:29.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:29.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:29.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:29.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:29.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:29.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 190 2024-09-14T21:26:29.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 191 2024-09-14T21:26:29.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:29.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:30.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:30.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:30.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:30.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:30.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:30.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:30.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:30.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:30.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 193 2024-09-14T21:26:30.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:31.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 192 2024-09-14T21:26:31.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:32.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 195 2024-09-14T21:26:32.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 194 2024-09-14T21:26:32.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:32.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:32.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:32.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:32.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:32.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:32.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:32.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:32.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:32.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:32.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:32.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:32.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:33.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 197 2024-09-14T21:26:33.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 198 2024-09-14T21:26:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 196 2024-09-14T21:26:33.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:33.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:33.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:33.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:33.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:33.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:33.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:33.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:33.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 199 2024-09-14T21:26:33.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:35.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:35.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 201 2024-09-14T21:26:35.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 200 2024-09-14T21:26:35.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:35.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 203 2024-09-14T21:26:35.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:36.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 202 2024-09-14T21:26:36.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 205 2024-09-14T21:26:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:36.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 204 2024-09-14T21:26:36.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:36.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:36.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:36.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:36.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:36.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:36.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:36.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:37.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 208 2024-09-14T21:26:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 206 2024-09-14T21:26:37.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 207 2024-09-14T21:26:37.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:37.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:37.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:38.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:38.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:38.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:38.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:38.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:38.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:39.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 209 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:39.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:39.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:39.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 211 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:39.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 210 2024-09-14T21:26:39.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:39.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:40.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:40.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:40.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:40.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:40.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:40.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:40.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:40.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:40.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:40.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:40.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:40.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:40.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:40.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 213 2024-09-14T21:26:40.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:41.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 212 2024-09-14T21:26:41.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:41.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 214 2024-09-14T21:26:41.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 215 2024-09-14T21:26:41.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:41.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:42.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 217 2024-09-14T21:26:42.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 216 2024-09-14T21:26:42.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 218 2024-09-14T21:26:42.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:42.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:42.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:42.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:42.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:42.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:42.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:42.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:42.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:42.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:42.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:42.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:42.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:42.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:42.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:42.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:42.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:42.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:42.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:42.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:42.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:43.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 219 2024-09-14T21:26:43.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:43.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:44.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:44.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:44.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:44.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:44.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:44.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:44.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:44.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:44.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:44.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:44.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:44.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:44.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:45.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:45.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:45.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:45.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:45.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:45.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 221 2024-09-14T21:26:45.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 220 2024-09-14T21:26:45.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:45.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:45.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 222 2024-09-14T21:26:45.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:45.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 223 2024-09-14T21:26:45.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:46.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:46.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 225 2024-09-14T21:26:46.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:46.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 224 2024-09-14T21:26:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:47.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 227 2024-09-14T21:26:47.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 226 2024-09-14T21:26:47.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:47.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 228 2024-09-14T21:26:47.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:48.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:48.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:48.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:48.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:48.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:48.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:48.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:48.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:48.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:48.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:48.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:48.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:48.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:48.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:48.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:48.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:48.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:48.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:48.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:49.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 229 2024-09-14T21:26:49.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:49.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 231 2024-09-14T21:26:49.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 230 2024-09-14T21:26:49.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:49.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:49.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:49.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:49.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:49.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:49.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:49.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:49.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:50.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:50.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:50.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:50.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:50.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:50.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:50.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:50.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:51.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 232 2024-09-14T21:26:51.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 233 2024-09-14T21:26:51.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 235 2024-09-14T21:26:51.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:51.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:51.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:52.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 234 2024-09-14T21:26:52.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:52.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 236 2024-09-14T21:26:52.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 238 2024-09-14T21:26:52.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:52.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 237 2024-09-14T21:26:52.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:52.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:52.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:52.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:52.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:53.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 239 2024-09-14T21:26:53.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:54.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:54.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:54.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:54.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:54.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:54.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:54.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:54.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:54.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:54.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:54.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:54.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:54.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:55.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:55.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:26:55.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:26:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:26:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:26:55.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:26:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:26:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:26:55.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:26:55.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 241 2024-09-14T21:26:55.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 240 2024-09-14T21:26:55.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:55.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:55.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 242 2024-09-14T21:26:55.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 243 2024-09-14T21:26:55.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:55.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:56.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 244 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:26:56.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:26:56.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:56.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 245 2024-09-14T21:26:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:58.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 246 2024-09-14T21:26:58.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 247 2024-09-14T21:26:58.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 248 2024-09-14T21:26:58.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:58.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:58.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:26:58.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:26:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:26:58.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:26:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:26:58.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:26:58.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:58.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:26:58.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:58.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:58.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:26:58.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:26:59.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 249 2024-09-14T21:26:59.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:59.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 250 2024-09-14T21:26:59.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:59.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 251 2024-09-14T21:26:59.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:26:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:26:59.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:01.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 252 2024-09-14T21:27:01.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 253 2024-09-14T21:27:01.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:01.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:01.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:01.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:01.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:01.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:01.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:01.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:01.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:01.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:01.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:01.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:01.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:27:01.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:02.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 254 2024-09-14T21:27:02.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 255 2024-09-14T21:27:02.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:02.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:02.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:02.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:02.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:02.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:02.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:02.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:27:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:27:02.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 258 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:02.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:02.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 257 2024-09-14T21:27:02.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 256 2024-09-14T21:27:02.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:02.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:02.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:03.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 259 2024-09-14T21:27:03.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:04.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:27:04.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:27:05.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 260 2024-09-14T21:27:05.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 261 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:05.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:27:05.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:05.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:05.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:05.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 263 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:05.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:05.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:05.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:05.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:05.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:05.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:05.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 262 2024-09-14T21:27:05.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:05.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:06.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 265 2024-09-14T21:27:06.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:06.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 264 2024-09-14T21:27:06.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:06.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:08.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 267 2024-09-14T21:27:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 266 2024-09-14T21:27:08.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 268 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:27:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:08.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:08.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:08.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:27:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:27:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:27:09.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 269 2024-09-14T21:27:09.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:09.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:27:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:27:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:09.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 270 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:09.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 271 2024-09-14T21:27:09.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:09.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:11.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 272 2024-09-14T21:27:11.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 273 2024-09-14T21:27:11.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:27:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:27:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:27:11.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:11.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:11.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:11.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:11.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:11.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:11.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:11.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:11.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:12.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 274 2024-09-14T21:27:12.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 275 2024-09-14T21:27:12.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:12.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:12.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 276 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:12.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:12.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 278 2024-09-14T21:27:12.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 277 2024-09-14T21:27:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:27:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:12.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:13.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 279 2024-09-14T21:27:13.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:14.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:14.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:14.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:14.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:27:14.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:14.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:14.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:27:14.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:27:15.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:15.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:27:15.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:15.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:15.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:27:15.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:15.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:15.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:15.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:15.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 280 2024-09-14T21:27:15.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 281 2024-09-14T21:27:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:15.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:15.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:15.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:15.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:15.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:15.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:27:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:15.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:27:15.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:27:15.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:15.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:15.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:15.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:15.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:15.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 282 2024-09-14T21:27:15.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 283 2024-09-14T21:27:15.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:16.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 284 2024-09-14T21:27:16.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 285 2024-09-14T21:27:16.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:16.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 286 2024-09-14T21:27:18.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 287 2024-09-14T21:27:18.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 288 2024-09-14T21:27:18.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:18.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:18.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:18.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:18.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:27:18.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:18.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:18.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:27:18.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:18.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:27:19.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 289 2024-09-14T21:27:19.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:19.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:19.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:27:19.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:19.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:19.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:27:19.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:19.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 290 2024-09-14T21:27:19.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 291 2024-09-14T21:27:19.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:19.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:21.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:27:21.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:27:21.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:21.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:21.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:21.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:21.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:21.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:21.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 292 2024-09-14T21:27:21.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 293 2024-09-14T21:27:21.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:21.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 295 2024-09-14T21:27:22.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 294 2024-09-14T21:27:22.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 296 2024-09-14T21:27:22.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 297 2024-09-14T21:27:22.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 298 2024-09-14T21:27:22.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:22.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:22.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:27:22.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:22.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:22.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:27:22.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:27:22.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:22.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:22.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:22.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:22.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:22.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:23.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 299 2024-09-14T21:27:23.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:24.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 301 2024-09-14T21:27:24.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 300 2024-09-14T21:27:24.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:24.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:24.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:27:24.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:27:25.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:27:25.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:27:25.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:25.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:27:25.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:25.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:25.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:27:25.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:25.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35751 2024-09-14T21:27:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 302 2024-09-14T21:27:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 303 2024-09-14T21:27:25.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:25.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:26.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 304 2024-09-14T21:27:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 305 2024-09-14T21:27:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:27:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:27:26.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:27:26.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:26.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:27.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 306 2024-09-14T21:27:27.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 307 2024-09-14T21:27:27.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:27.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35891 2024-09-14T21:27:27.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:27.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:27:27.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:27.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:27.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:27:27.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:27:28.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:28.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:27:28.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:28.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:28.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:27:28.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:27:28.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:28.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36043 2024-09-14T21:27:29.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 308 2024-09-14T21:27:29.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:29.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:29.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36176 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:27:29.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:27:30.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 309 2024-09-14T21:27:30.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:27:30.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:27:30.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:30.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36328 2024-09-14T21:27:31.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 310 2024-09-14T21:27:31.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:32.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 311 2024-09-14T21:27:32.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:32.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:32.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36481 2024-09-14T21:27:33.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 312 2024-09-14T21:27:33.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:33.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36654 2024-09-14T21:27:33.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:27:34.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:34.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36808 2024-09-14T21:27:35.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:27:35.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36981 2024-09-14T21:27:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:27:36.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:27:36.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35488 2024-09-14T21:30:01.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:01.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:01.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:01.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35752 2024-09-14T21:30:02.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:02.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:02.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:02.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 35892 2024-09-14T21:30:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36044 2024-09-14T21:30:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36177 2024-09-14T21:30:06.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:06.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36329 2024-09-14T21:30:06.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:06.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:06.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:06.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36482 2024-09-14T21:30:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:07.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:07.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:07.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36655 2024-09-14T21:30:08.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:08.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36809 2024-09-14T21:30:10.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:10.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:10.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:30:10.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 36982 2024-09-14T21:30:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:30:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:30:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:30:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T21:30:10.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T21:30:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T21:30:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T21:30:10.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T21:30:10.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:30:10.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T21:30:10.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:30:10.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:30:10.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42954 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T21:30:10.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T21:30:10.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T21:30:10.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T21:30:10.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:30:10.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T21:30:11.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:30:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:30:11.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:30:11.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:30:11.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:30:11.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:30:11.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:30:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:30:11.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:30:11.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:30:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:30:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:11.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c7a60ee56b6b9537d3b28e55bd0cfe70 2024-09-14T21:31:11.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T21:31:12.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T21:31:12.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:12.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:12.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:12.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T21:31:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:13.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:14.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=b51175b9dd002c2613e006ae3dbfceec 2024-09-14T21:31:14.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T21:31:14.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:14.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:14.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:14.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:14.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:14.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:14.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:14.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:14.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:14.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T21:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T21:31:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:14.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:14.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:14.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:14.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:14.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:14.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:14.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:15.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ba74b59da43277ce02ceaba9404e1d5a 2024-09-14T21:31:15.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T21:31:15.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T21:31:15.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:15.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:15.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:15.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T21:31:16.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0ab547aae2b9fa30e595ac36a16d132d 2024-09-14T21:31:16.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T21:31:16.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=b899a8b56993658dfdd1aeabfd060ab0 2024-09-14T21:31:16.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T21:31:16.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=b9ae4432e4fab431343627ffd84c28f4 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:16.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T21:31:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T21:31:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T21:31:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T21:31:16.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:16.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T21:31:16.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T21:31:16.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:16.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T21:31:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:16.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:16.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:16.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:16.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:16.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:31:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=5bcf4205c690b8c1bfa52b5168d08a27 2024-09-14T21:31:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T21:31:16.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=3865797517bd497e8c226c1397cc91a9 2024-09-14T21:31:16.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T21:31:16.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:16.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:16.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:16.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:16.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:16.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T21:31:16.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:16.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:16.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:16.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T21:31:17.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T21:31:17.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:17.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T21:31:17.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=5d61b831236187c331a5a17eafd3f1ff 2024-09-14T21:31:17.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T21:31:17.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T21:31:17.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:17.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T21:31:17.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:17.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:17.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:31:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:17.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:31:17.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:17.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:17.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:17.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T21:31:17.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:17.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:17.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:17.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:17.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:17.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:17.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:17.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:17.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=274d296f991afbd40d31cd640131b2a0 2024-09-14T21:31:17.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T21:31:17.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T21:31:17.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:17.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:17.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T21:31:18.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:18.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:31:18.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T21:31:18.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:18.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:18.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:18.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:18.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:31:18.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:31:18.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:18.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:18.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:18.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:18.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:18.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:31:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:31:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:31:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:18.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:18.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:31:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:31:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:18.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:18.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:18.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:18.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:18.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:18.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:18.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:18.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:18.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:18.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:18.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:19.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:19.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:19.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:19.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:19.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:19.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:31:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:31:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:19.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:19.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:19.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:19.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:19.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:19.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:19.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:19.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:19.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:19.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:31:19.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:31:19.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:19.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:19.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:19.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:31:20.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:31:20.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:31:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:31:20.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:31:20.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:31:20.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:31:20.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:20.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:20.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:20.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:20.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:20.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:20.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:21.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:21.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:21.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:21.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:21.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:21.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:21.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:21.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:21.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:21.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:21.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:31:21.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:21.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:21.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:21.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:21.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:21.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:21.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:21.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:21.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:22.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:31:22.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:22.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:31:22.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:31:22.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:31:22.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:22.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:22.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:22.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:22.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:22.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:22.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:22.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:23.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:23.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:23.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:23.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:23.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:24.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:31:24.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:24.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:24.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:24.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:24.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:31:24.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:31:24.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:24.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:24.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:31:24.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:31:24.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:24.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:24.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:24.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:24.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:24.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:24.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:24.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:24.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:31:24.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:31:24.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:31:24.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:31:24.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:31:24.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:31:24.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:24.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:24.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:24.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:24.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:24.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:24.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:24.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:24.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:24.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:24.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:24.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:24.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:24.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:24.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:31:24.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:24.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:24.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:24.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:24.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:24.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:24.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:25.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:25.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:25.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:25.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:25.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:31:25.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:31:25.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:31:25.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:25.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:25.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:25.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:25.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:25.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:25.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:25.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:25.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:31:25.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:31:25.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:25.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:25.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:25.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:25.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:25.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:25.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:25.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:26.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:26.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:26.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:26.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:31:26.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:31:26.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:31:26.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:26.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:26.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:26.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:26.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:26.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:26.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:26.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:29.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:29.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:29.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:01' 2024-09-14T21:31:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:29.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:31:29.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:29.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:31.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:31.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:31.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:31:31.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:31.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:31.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:31.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:31.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:31.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:31.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:31.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:31.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:31.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:31.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:31.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:31:31.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:31.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:31:31.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:31.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:31.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:31.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:32.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:31:32.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:31:32.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:31:32.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:32.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:32.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:32.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:32.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:32.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:32.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:31:32.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:31:32.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:32.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:32.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:32.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:32.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:32.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:32.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:32.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:32.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:32.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:32.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:32.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:32.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:32.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:32.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:32.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:32.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:32.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:32.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:32.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:32.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:32.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:32.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:32.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:32.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:32.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:32.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:32.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:32.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:32.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:32.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:32.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:32.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:32.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:32.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:32.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:32.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:32.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:32.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T21:31:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:31:32.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:32.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:31:32.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:31:33.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:31:33.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T21:31:33.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:31:33.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:31:33.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:31:33.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:33.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:33.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:33.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T21:31:33.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:33.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:33.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:33.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:33.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:33.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:33.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:31:33.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:31:33.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:31:33.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:31:33.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:33.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:31:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:31:33.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:31:33.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:33.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T21:31:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:33.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:33.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:33.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:33.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:33.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:33.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:31:33.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T21:31:33.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:31:33.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:33.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:33.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:31:33.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:31:33.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:33.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:33.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:33.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:33.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:33.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:33.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:33.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:33.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:33.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:33.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:33.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:33.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:33.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:33.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:33.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:33.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:31:33.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:33.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:33.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:31:33.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:31:33.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:33.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:31:33.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:33.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:33.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:33.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:33.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:34.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T21:31:34.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T21:31:34.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T21:31:34.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:34.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:34.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:31:34.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:31:34.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:31:34.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:31:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:31:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T21:31:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T21:31:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:31:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T21:31:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:31:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:31:34.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T21:31:34.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:31:34.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:34.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T21:31:34.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:31:34.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:31:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T21:31:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:31:34.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:31:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:31:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:34.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:31:34.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:31:34.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:34.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:34.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:34.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:34.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T21:31:34.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T21:31:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:31:34.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:31:34.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:34.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:34.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:34.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:34.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:34.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:34.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:34.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:34.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:34.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:34.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:34.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:35.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:35.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:35.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:35.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:31:35.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:35.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:35.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:31:35.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:35.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:35.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:31:35.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:31:35.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:35.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T21:31:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:35.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T21:31:35.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:35.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:35.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:31:35.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:35.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T21:31:35.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:35.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T21:31:35.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T21:31:35.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T21:31:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T21:31:35.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T21:31:35.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T21:31:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T21:31:35.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T21:31:35.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:35.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:35.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:35.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:35.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T21:31:35.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T21:31:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:31:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T21:31:35.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T21:31:35.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:31:35.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:31:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T21:31:35.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T21:31:35.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:31:35.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T21:31:35.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:31:35.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:31:35.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:35.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T21:31:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:31:35.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:36.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:36.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:36.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:36.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:36.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:36.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:36.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:36.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:36.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:36.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:36.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:31:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:31:36.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:36.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:36.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:36.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:37.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:37.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:37.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:37.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:37.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:37.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:37.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:37.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:37.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:37.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:37.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:37.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:37.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:37.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:37.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:37.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:37.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:37.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T21:31:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:37.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:31:37.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:37.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:31:37.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:37.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:37.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:37.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:37.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:37.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:37.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T21:31:37.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:31:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:31:38.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T21:31:38.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:31:38.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:31:38.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:31:38.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T21:31:39.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:31:31' 2024-09-14T21:31:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:31:39.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:31:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:31:39.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:31:39.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:31:39.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:31:39.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:39.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:39.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:31:39.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:31:39.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:31:39.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 21:31:31' 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:31:31' 2024-09-14T21:31:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:31:39.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:31:39.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:31:39.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary266986fec-445a-4222-bcec-d90e90117313up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:31:31' 2024-09-14T21:31:39.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:31:39.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:31:39.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:31:31' 2024-09-14T21:31:39.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:31:39.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:31:39.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:31:39.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:31:39.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:31:39.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:31:39.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T21:31:40.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:31:40.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:31:40.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:31:40.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T21:31:41.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T21:31:41.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:31:41.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:32:26.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=5d61b831236187c331a5a17eafd3f1ff 2024-09-14T21:32:26.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T21:32:26.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=b51175b9dd002c2613e006ae3dbfceec 2024-09-14T21:32:26.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T21:32:27.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 5d61b831236187c331a5a17eafd3f1ff != \5\d\6\1\b\8\3\1\2\3\6\1\8\7\c\3\3\1\a\5\a\1\7\e\a\f\d\3\f\1\f\f ]] 2024-09-14T21:32:27.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ b51175b9dd002c2613e006ae3dbfceec != \b\5\1\1\7\5\b\9\d\d\0\0\2\c\2\6\1\3\e\0\0\6\a\e\3\d\b\f\c\e\e\c ]] 2024-09-14T21:32:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=b899a8b56993658dfdd1aeabfd060ab0 2024-09-14T21:32:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T21:32:29.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ b899a8b56993658dfdd1aeabfd060ab0 != \b\8\9\9\a\8\b\5\6\9\9\3\6\5\8\d\f\d\d\1\a\e\a\b\f\d\0\6\0\a\b\0 ]] 2024-09-14T21:32:30.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=b9ae4432e4fab431343627ffd84c28f4 2024-09-14T21:32:30.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T21:32:30.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ba74b59da43277ce02ceaba9404e1d5a 2024-09-14T21:32:30.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T21:32:30.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ b9ae4432e4fab431343627ffd84c28f4 != \b\9\a\e\4\4\3\2\e\4\f\a\b\4\3\1\3\4\3\6\2\7\f\f\d\8\4\c\2\8\f\4 ]] 2024-09-14T21:32:30.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:30.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42955 2024-09-14T21:32:30.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ba74b59da43277ce02ceaba9404e1d5a != \b\a\7\4\b\5\9\d\a\4\3\2\7\7\c\e\0\2\c\e\a\b\a\9\4\0\4\e\1\d\5\a ]] 2024-09-14T21:32:30.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=5bcf4205c690b8c1bfa52b5168d08a27 2024-09-14T21:32:30.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T21:32:31.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=3865797517bd497e8c226c1397cc91a9 2024-09-14T21:32:31.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T21:32:31.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0ab547aae2b9fa30e595ac36a16d132d 2024-09-14T21:32:31.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T21:32:31.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 3865797517bd497e8c226c1397cc91a9 != \3\8\6\5\7\9\7\5\1\7\b\d\4\9\7\e\8\c\2\2\6\c\1\3\9\7\c\c\9\1\a\9 ]] 2024-09-14T21:32:31.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 5bcf4205c690b8c1bfa52b5168d08a27 != \5\b\c\f\4\2\0\5\c\6\9\0\b\8\c\1\b\f\a\5\2\b\5\1\6\8\d\0\8\a\2\7 ]] 2024-09-14T21:32:31.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0ab547aae2b9fa30e595ac36a16d132d != \0\a\b\5\4\7\a\a\e\2\b\9\f\a\3\0\e\5\9\5\a\c\3\6\a\1\6\d\1\3\2\d ]] 2024-09-14T21:32:32.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=274d296f991afbd40d31cd640131b2a0 2024-09-14T21:32:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 274d296f991afbd40d31cd640131b2a0 != \2\7\4\d\2\9\6\f\9\9\1\a\f\b\d\4\0\d\3\1\c\d\6\4\0\1\3\1\b\2\a\0 ]] 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42957 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42959 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42961 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42963 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42965 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42967 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42969 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:32:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 42971 2024-09-14T21:32:32.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c7a60ee56b6b9537d3b28e55bd0cfe70 2024-09-14T21:32:32.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T21:32:32.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c7a60ee56b6b9537d3b28e55bd0cfe70 != \c\7\a\6\0\e\e\5\6\b\6\b\9\5\3\7\d\3\b\2\8\e\5\5\b\d\0\c\f\e\7\0 ]] 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:32.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:32.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:32.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:32.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T21:32:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:32:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:32:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9542e600-2b8c-44ef-9120-0336bdd0ac7e 2024-09-14T21:32:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3153510.4,"bytes_per_snapshot":63070208.0,"last_snapshot_bytes":63070208,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:33.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:33.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:33.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3153510.4,"bytes_per_snapshot":63070208.0,"last_snapshot_bytes":63070208,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:33.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:33.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:33.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:33.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:33.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:33.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:33.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:33.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:33.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:33.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:33.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:33.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary19542e600-2b8c-44ef-9120-0336bdd0ac7eup+replayingreplaying, {"bytes_per_second":3153510.4,"bytes_per_snapshot":63070208.0,"last_snapshot_bytes":63070208,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary266986fec-445a-4222-bcec-d90e90117313up+replayingreplaying, {"bytes_per_second":3411148.8,"bytes_per_snapshot":68222976.0,"last_snapshot_bytes":68222976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349497,"remote_snapshot_timestamp":1726349497,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+replayingreplaying, {"bytes_per_second":3095142.4,"bytes_per_snapshot":61902848.0,"last_snapshot_bytes":61902848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+replayingreplaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+replayingreplaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:33.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:32:33.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:33.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:32:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:33.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:33.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:33.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:33.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T21:32:33.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T21:32:33.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:33.918+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d38680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:33.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:33.918+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/9542e600-2b8c-44ef-9120-0336bdd0ac7e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:35.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:35.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T21:32:35.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:35.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:35.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:32:35.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:35.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:35.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T21:32:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:35.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:35.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:35.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:35.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:35.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T21:32:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 66986fec-445a-4222-bcec-d90e90117313 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3411148.8,"bytes_per_snapshot":68222976.0,"last_snapshot_bytes":68222976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349497,"remote_snapshot_timestamp":1726349497,"replay_state":"idle"} 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:36.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:36.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:36.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:36.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3411148.8,"bytes_per_snapshot":68222976.0,"last_snapshot_bytes":68222976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349497,"remote_snapshot_timestamp":1726349497,"replay_state":"idle"} 2024-09-14T21:32:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:36.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:36.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:36.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:36.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:36.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:37.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary266986fec-445a-4222-bcec-d90e90117313up+replayingreplaying, {"bytes_per_second":3411148.8,"bytes_per_snapshot":68222976.0,"last_snapshot_bytes":68222976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349497,"remote_snapshot_timestamp":1726349497,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+replayingreplaying, {"bytes_per_second":3095142.4,"bytes_per_snapshot":61902848.0,"last_snapshot_bytes":61902848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+replayingreplaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+replayingreplaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:37.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:37.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:32:37.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:32:37.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T21:32:37.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T21:32:37.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:37.251+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d39380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:37.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:37.252+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/66986fec-445a-4222-bcec-d90e90117313] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:38.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T21:32:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:32:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T21:32:38.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:38.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:38.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:38.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:38.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:38.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:38.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:39.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T21:32:39.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3095142.4,"bytes_per_snapshot":61902848.0,"last_snapshot_bytes":61902848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:39.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:39.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:39.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:39.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3095142.4,"bytes_per_snapshot":61902848.0,"last_snapshot_bytes":61902848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:39.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:39.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:39.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:39.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:39.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:39.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:39.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:39.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:39.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:39.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:39.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:40.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary31dc5f1ee-5fc9-4c4a-9623-ef5afd329d6eup+replayingreplaying, {"bytes_per_second":3095142.4,"bytes_per_snapshot":61902848.0,"last_snapshot_bytes":61902848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+replayingreplaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+replayingreplaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:40.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:40.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:32:40.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:40.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:32:40.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:40.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:40.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T21:32:40.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T21:32:40.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:40.253+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3f380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:40.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:40.253+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/1dc5f1ee-5fc9-4c4a-9623-ef5afd329d6e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:41.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:41.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T21:32:41.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:41.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:41.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:32:41.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:41.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:41.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T21:32:41.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:41.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T21:32:41.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:41.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:32:41.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T21:32:41.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:41.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:41.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:42.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:42.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:42.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1e2fb004-fd54-4929-b045-e65d21d3ec94 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:42.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:42.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:42.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:42.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:42.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:42.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:42.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:42.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:42.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:42.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:42.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:42.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:42.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:42.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:42.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:42.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:43.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary41e2fb004-fd54-4929-b045-e65d21d3ec94up+replayingreplaying, {"bytes_per_second":3257139.2,"bytes_per_snapshot":65142784.0,"last_snapshot_bytes":65142784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+replayingreplaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:43.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:43.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:32:43.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:43.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:32:43.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:43.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:43.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:43.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:43.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:43.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:43.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T21:32:43.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:43.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:43.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:43.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T21:32:43.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T21:32:43.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:43.248+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3fba0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:43.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:43.248+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcac80 [3/1e2fb004-fd54-4929-b045-e65d21d3ec94] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:44.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T21:32:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:32:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T21:32:44.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:44.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T21:32:44.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:44.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:44.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:44.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:45.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:45.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:45.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 434b8979-9539-4cca-ab17-31e1d63a5de9 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"} 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:45.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:45.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:45.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:45.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"} 2024-09-14T21:32:45.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:45.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:45.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:45.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:45.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:45.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:45.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:45.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:45.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:45.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:46.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary5434b8979-9539-4cca-ab17-31e1d63a5de9up+replayingreplaying, {"bytes_per_second":3426304.0,"bytes_per_snapshot":68526080.0,"last_snapshot_bytes":68526080,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349493,"remote_snapshot_timestamp":1726349493,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:46.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:46.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:32:46.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:46.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:32:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:46.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:46.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T21:32:46.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T21:32:46.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:46.278+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3e9c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:46.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:46.278+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaf00 [3/434b8979-9539-4cca-ab17-31e1d63a5de9] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:47.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:47.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:47.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T21:32:47.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:47.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:47.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:47.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:48.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:48.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:48.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:48.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:32:48.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:32:48.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 59fd338e-237b-4bb9-bee7-fd701bd47e49 2024-09-14T21:32:48.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:48.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:48.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:48.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:48.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:48.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:48.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:48.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:48.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:48.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:48.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:48.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:48.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:48.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:48.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:48.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:48.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:48.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:48.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:48.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary659fd338e-237b-4bb9-bee7-fd701bd47e49up+replayingreplaying, {"bytes_per_second":3306700.8,"bytes_per_snapshot":66134016.0,"last_snapshot_bytes":66134016,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:48.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:48.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:32:48.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:48.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:32:48.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:48.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:48.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:48.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:48.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T21:32:48.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T21:32:49.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:49.046+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3f520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:49.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:49.046+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/59fd338e-237b-4bb9-bee7-fd701bd47e49] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:50.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:50.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T21:32:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:32:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:50.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T21:32:50.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:50.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T21:32:50.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:50.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:50.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:50.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:50.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:50.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:51.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:51.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:51.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:51.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:32:51.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:32:51.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8e972140-a32d-4099-8c2d-735374481e02 2024-09-14T21:32:51.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:51.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:51.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:51.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:51.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:51.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:51.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:51.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:51.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:51.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:51.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:51.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:51.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:51.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:51.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:51.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:52.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary78e972140-a32d-4099-8c2d-735374481e02up+replayingreplaying, {"bytes_per_second":3148595.2,"bytes_per_snapshot":62971904.0,"last_snapshot_bytes":62971904,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:52.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:52.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:32:52.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:52.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:32:52.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:52.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:52.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:52.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:52.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:52.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:52.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T21:32:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T21:32:52.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T21:32:52.279 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:52.278+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3eb60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:52.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:52.278+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/8e972140-a32d-4099-8c2d-735374481e02] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:53.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T21:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:53.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:53.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T21:32:53.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:53.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:53.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:53.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:53.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:53.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:53.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:54.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:54.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:54.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a32d18c5-6fef-4328-a1f6-b7559ed0e37e 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:54.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:54.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:54.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:54.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:54.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:54.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:54.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:54.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:54.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:54.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:54.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:54.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:54.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:54.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:54.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary8a32d18c5-6fef-4328-a1f6-b7559ed0e37eup+replayingreplaying, {"bytes_per_second":3234406.4,"bytes_per_snapshot":64688128.0,"last_snapshot_bytes":64688128,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:54.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:32:54.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:54.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:32:54.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:54.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:54.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:54.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:54.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:54.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T21:32:54.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:54.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:54.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:54.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T21:32:54.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T21:32:54.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:54.956+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d3f860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:54.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:54.956+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/a32d18c5-6fef-4328-a1f6-b7559ed0e37e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:56.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T21:32:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:32:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T21:32:56.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:56.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T21:32:56.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:56.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:56.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:57.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:57.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:57.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 9dbed751-870e-45c5-867f-7e8ab2bf8de6 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:32:57.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:32:57.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:32:57.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:32:57.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:32:57.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"} 2024-09-14T21:32:57.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:32:57.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:57.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:32:57.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:57.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:32:57.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:32:57.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:32:57.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:32:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:32:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:32:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:32:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:32:57.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:32:57.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31image-primary99dbed751-870e-45c5-867f-7e8ab2bf8de6up+replayingreplaying, {"bytes_per_second":3231129.6,"bytes_per_snapshot":64622592.0,"last_snapshot_bytes":64622592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349495,"remote_snapshot_timestamp":1726349495,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:32:57.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:32:57.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:32:57.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:32:57.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:32:57.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:32:57.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:32:57.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:32:57.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:57.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T21:32:57.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T21:32:57.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:57.942+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b587922ea0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:32:57.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:32:57.942+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb680 [3/9dbed751-870e-45c5-867f-7e8ab2bf8de6] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:32:59.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:32:59.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T21:32:59.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:59.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:59.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:32:59.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:59.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:32:59.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T21:32:59.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:32:59.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:32:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:32:59.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:32:59.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:32:59.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:33:00.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:33:00.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:33:00.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:33:00.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:33:00.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:33:00.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8de747ac-4066-458a-82e0-c851b96293cc 2024-09-14T21:33:00.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:33:00.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"} 2024-09-14T21:33:00.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:33:00.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:32:31' 2024-09-14T21:33:00.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:33:00.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:33:00.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:33:00.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"} 2024-09-14T21:33:00.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:33:00.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:33:00.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:33:00.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:33:00.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:33:00.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:33:00.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:33:00.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:33:00.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 21:32:31' 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:32:31' 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:33:00.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:33:00.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108de747ac-4066-458a-82e0-c851b96293ccup+replayingreplaying, {"bytes_per_second":3210240.0,"bytes_per_snapshot":64204800.0,"last_snapshot_bytes":64204800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349500,"remote_snapshot_timestamp":1726349500,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:32:31' 2024-09-14T21:33:00.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:33:00.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:33:00.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:32:31' 2024-09-14T21:33:00.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:33:00.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:33:00.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:33:00.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:33:00.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:00.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T21:33:00.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T21:33:00.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:33:00.963+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d38820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:33:00.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:33:00.963+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/8de747ac-4066-458a-82e0-c851b96293cc] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:33:01.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:33:01.184+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d389c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:33:01.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:33:01.184+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/8de747ac-4066-458a-82e0-c851b96293cc] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:33:02.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:33:02.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T21:33:02.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:02.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:02.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:02.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:33:02.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:33:02.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T21:33:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T21:33:02.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T21:33:02.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T21:33:02.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T21:33:02.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T21:33:02.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:02.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:02.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:02.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T21:33:02.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:02.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:02.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T21:33:03.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:03.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T21:33:03.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 154e86ff71ac 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.154e86ff71ac 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:02 2024 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:02 2024 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:02 2024 2024-09-14T21:33:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:33:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:03.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:03.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:03.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T21:33:03.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T21:33:03.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:03.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T21:33:03.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:03.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 7591f638-70f4-419b-bca9-8f9ec72877f1 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:03.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:03.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:03.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:03.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:03.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T21:33:03.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T21:33:03.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:03.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T21:33:03.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:03.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T21:33:03.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:03.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T21:33:03.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:03.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:03.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:03.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:03.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:03.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T21:33:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T21:33:04.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:04.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 334 2024-09-14T21:33:04.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:04.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T21:33:04.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 155e28a9d33f 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.155e28a9d33f 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:03 2024 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:03 2024 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:03 2024 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:04.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:04.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:33:04.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T21:33:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T21:33:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T21:33:04.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:04.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:04.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 28d67ef4-0d50-45d5-8ae2-be6f46f30820 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:04.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:04.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:04.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:04.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:04.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T21:33:04.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T21:33:04.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:04.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T21:33:04.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:04.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T21:33:04.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:04.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:04.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T21:33:04.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T21:33:04.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:04.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:04.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T21:33:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:04.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T21:33:05.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:05.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T21:33:05.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:05.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 336 2024-09-14T21:33:05.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T21:33:05.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 156d934948ff 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.156d934948ff 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:04 2024 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:04 2024 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:04 2024 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:33:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:05.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:05.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:05.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T21:33:05.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T21:33:05.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:05.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T21:33:05.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:05.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:05.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 3459c830-990b-417f-9803-67d4f7865451 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:05.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:05.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:05.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:05.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:05.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T21:33:05.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T21:33:05.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:05.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T21:33:05.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:05.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T21:33:05.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:33:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:05.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:05.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:05.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T21:33:05.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:05.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T21:33:06.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:06.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 338 2024-09-14T21:33:06.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:06.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T21:33:06.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T21:33:06.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:06.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:06.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:06.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 157b49a83eb4 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.157b49a83eb4 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:05 2024 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:05 2024 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:05 2024 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:33:06.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:06.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:06.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:06.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T21:33:06.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T21:33:06.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:06.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T21:33:06.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: d2ff6fc5-ae90-470d-b2ed-cdf6d1f89496 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:06.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:06.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:06.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:06.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:06.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T21:33:06.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T21:33:06.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:06.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T21:33:06.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T21:33:06.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:06.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:06.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:06.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:06.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:06.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T21:33:06.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:06.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T21:33:07.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:07.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 340 2024-09-14T21:33:07.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T21:33:07.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 158979f2909a 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.158979f2909a 2024-09-14T21:33:07.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:06 2024 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:06 2024 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:06 2024 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:33:07.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T21:33:07.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T21:33:07.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:07.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T21:33:07.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:07.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:07.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:07.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 8eaebe55-1fc2-46d7-b110-426efbe738a4 2024-09-14T21:33:07.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:07.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:07.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:07.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:07.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:07.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:07.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:07.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T21:33:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T21:33:07.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:07.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:07.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T21:33:07.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:07.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T21:33:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T21:33:08.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:08.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 342 2024-09-14T21:33:08.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 343 2024-09-14T21:33:08.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:08.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:08.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:08.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 159b9eb4916b 2024-09-14T21:33:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.159b9eb4916b 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:07 2024 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:07 2024 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:07 2024 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:33:08.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:08.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:08.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:08.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T21:33:08.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T21:33:08.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:08.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T21:33:08.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:08.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:08.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:08.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b7041618-dc5c-4408-abe4-eb0d45c3b75e 2024-09-14T21:33:08.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:08.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:08.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:08.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:08.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:08.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:08.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:08.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:08.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T21:33:08.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T21:33:08.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:08.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T21:33:08.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:08.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T21:33:08.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:08.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T21:33:08.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:08.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T21:33:09.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:09.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 346 2024-09-14T21:33:09.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 345 2024-09-14T21:33:09.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:09.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T21:33:09.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 15ad42e29260 2024-09-14T21:33:09.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.15ad42e29260 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:08 2024 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:08 2024 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:08 2024 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:33:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:09.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:09.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:09.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T21:33:09.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T21:33:09.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:09.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T21:33:09.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: dba8e747-a699-4ece-bfa0-4252eed61cb1 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:09.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:09.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:09.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:09.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:09.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T21:33:09.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T21:33:09.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:09.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:09.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:09.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T21:33:09.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:09.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:09.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:09.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:09.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T21:33:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:10.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:10.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:10.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 349 2024-09-14T21:33:10.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 348 2024-09-14T21:33:10.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T21:33:10.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:10.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:10.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T21:33:10.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:10.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:10.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:10.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 15bf4a764f1 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.15bf4a764f1 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:09 2024 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:09 2024 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:09 2024 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:33:10.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:10.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:10.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:10.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T21:33:10.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T21:33:10.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:10.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T21:33:10.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:10.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:10.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: ed051345-7b8f-4590-9ab1-35a1c34666de 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:10.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:10.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:10.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:10.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:10.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T21:33:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T21:33:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:10.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T21:33:10.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:10.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:10.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:10.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T21:33:10.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:10.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:10.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:10.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:10.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T21:33:11.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:11.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:11.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:11.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:11.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:11.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:11.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:11.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 352 2024-09-14T21:33:11.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:11.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 351 2024-09-14T21:33:11.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:11.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:11.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T21:33:11.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T21:33:11.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 15d12c77f398 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.15d12c77f398 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:10 2024 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:10 2024 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:10 2024 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:33:11.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:11.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:11.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:11.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T21:33:11.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T21:33:11.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:11.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T21:33:11.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:11.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:11.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:11.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 0ff863d6-8b24-43de-b877-7f450df07f70 2024-09-14T21:33:11.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:11.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:11.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:11.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:11.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:11.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:11.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:11.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:11.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T21:33:11.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T21:33:11.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:11.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T21:33:11.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:33:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T21:33:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:33:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:33:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:33:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T21:33:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:33:11.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T21:33:12.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:12.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T21:33:12.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 355 2024-09-14T21:33:12.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:33:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 356 2024-09-14T21:33:12.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 354 2024-09-14T21:33:12.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:12.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:12.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:12.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:12.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:12.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:12.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:12.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:12.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:12.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:12.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:12.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:12.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T21:33:12.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:12.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:12.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 15e64bffe0b2 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.15e64bffe0b2 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:33:11 2024 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:33:11 2024 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:33:11 2024 2024-09-14T21:33:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:33:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:33:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:33:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:33:12.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:33:12.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:33:12.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T21:33:12.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T21:33:12.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:33:12.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T21:33:12.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:33:12.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:33:12.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:33:12.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 6bac0069-cc84-4a22-8407-b44577d119ae 2024-09-14T21:33:12.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:33:12.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:33:12.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:12.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:33:12.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:33:12.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:33:12.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:33:12.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:33:12.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T21:33:12.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T21:33:12.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:33:12.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T21:33:12.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:33:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47328 2024-09-14T21:33:12.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T21:33:12.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T21:33:12.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T21:33:13.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:13.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:13.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:13.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 359 2024-09-14T21:33:13.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 360 2024-09-14T21:33:13.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 358 2024-09-14T21:33:13.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:33:13.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T21:33:13.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:13.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:13.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:14.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 362 2024-09-14T21:33:14.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 361 2024-09-14T21:33:14.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:14.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:15.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:15.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:15.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:15.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:15.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:15.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:15.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:15.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 363 2024-09-14T21:33:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 364 2024-09-14T21:33:15.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:15.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:16.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:16.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:16.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:16.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 366 2024-09-14T21:33:16.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 367 2024-09-14T21:33:16.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 365 2024-09-14T21:33:16.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:16.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:16.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:16.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:16.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:16.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:16.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:17.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:17.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 370 2024-09-14T21:33:17.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 369 2024-09-14T21:33:17.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 368 2024-09-14T21:33:17.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:17.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:17.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:18.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 372 2024-09-14T21:33:18.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 371 2024-09-14T21:33:18.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:18.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:18.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:18.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:18.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:18.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:18.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:18.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:19.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:19.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:19.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:19.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:19.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:19.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:19.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 374 2024-09-14T21:33:19.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 373 2024-09-14T21:33:19.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:20.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:20.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:20.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:20.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 375 2024-09-14T21:33:20.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 377 2024-09-14T21:33:20.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 376 2024-09-14T21:33:20.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:20.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:20.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:21.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:21.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:21.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:21.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:21.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:21.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:21.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:21.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:21.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:21.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:21.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:21.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:21.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 379 2024-09-14T21:33:21.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:21.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 378 2024-09-14T21:33:21.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 380 2024-09-14T21:33:21.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:21.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:22.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 382 2024-09-14T21:33:22.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 381 2024-09-14T21:33:22.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:22.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:22.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:23.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 383 2024-09-14T21:33:23.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 384 2024-09-14T21:33:23.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:23.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:23.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:23.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:23.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:23.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:23.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:23.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:23.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:23.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:24.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 387 2024-09-14T21:33:24.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 385 2024-09-14T21:33:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:24.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:24.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:24.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:24.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:24.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:24.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:24.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:24.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:24.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:24.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:24.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:24.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:24.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:24.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:25.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:25.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:25.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 390 2024-09-14T21:33:25.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 388 2024-09-14T21:33:25.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:25.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:26.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 386 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:26.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:26.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:26.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:26.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 391 2024-09-14T21:33:26.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:27.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 389 2024-09-14T21:33:27.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:27.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:27.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:27.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:27.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:27.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:27.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:27.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 393 2024-09-14T21:33:27.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:28.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 392 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:28.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:28.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 395 2024-09-14T21:33:28.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:29.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 394 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:29.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:29.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:29.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 397 2024-09-14T21:33:29.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:29.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:29.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:29.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:29.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:29.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:29.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:30.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:30.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 396 2024-09-14T21:33:30.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:30.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 399 2024-09-14T21:33:30.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:31.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 398 2024-09-14T21:33:31.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:31.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 401 2024-09-14T21:33:31.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:32.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 400 2024-09-14T21:33:32.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:32.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 403 2024-09-14T21:33:32.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:32.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:32.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:32.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:32.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:32.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:32.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:32.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:33.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 402 2024-09-14T21:33:33.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:33.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:33.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:33.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:33.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:33.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:33.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:33.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:33.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:33.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:33.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:33.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:33.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 405 2024-09-14T21:33:33.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:34.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 404 2024-09-14T21:33:34.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:34.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:34.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:34.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:34.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:34.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:34.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:34.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 407 2024-09-14T21:33:34.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:35.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:35.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:35.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:35.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 406 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:35.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 409 2024-09-14T21:33:35.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:36.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 408 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:36.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 411 2024-09-14T21:33:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:37.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 410 2024-09-14T21:33:37.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:37.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:37.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:37.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:37.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:37.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:37.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:37.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 413 2024-09-14T21:33:37.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:37.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:37.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:37.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:37.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:37.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:37.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:38.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 412 2024-09-14T21:33:38.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:38.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:38.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 415 2024-09-14T21:33:38.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:38.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:38.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:38.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:38.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:38.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:39.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 414 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:39.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 417 2024-09-14T21:33:39.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:39.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:40.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:40.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 416 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:40.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 420 2024-09-14T21:33:40.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:41.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 418 2024-09-14T21:33:41.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:41.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:41.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:41.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:41.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:41.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:41.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:41.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 421 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:41.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:42.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 419 2024-09-14T21:33:42.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:42.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 423 2024-09-14T21:33:42.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:42.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:42.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:42.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:42.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:43.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 422 2024-09-14T21:33:43.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:43.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 425 2024-09-14T21:33:43.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:44.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 424 2024-09-14T21:33:44.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:44.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 427 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:44.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:44.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:44.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:44.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:44.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:44.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:44.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:44.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:45.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 426 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:45.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:45.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:45.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:45.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 429 2024-09-14T21:33:45.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 428 2024-09-14T21:33:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:46.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:46.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 431 2024-09-14T21:33:46.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:46.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:46.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:46.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:46.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:46.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:46.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:47.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 430 2024-09-14T21:33:47.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:47.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:47.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 433 2024-09-14T21:33:47.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:47.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:48.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 432 2024-09-14T21:33:48.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:48.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:48.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 435 2024-09-14T21:33:48.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:49.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 434 2024-09-14T21:33:49.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:49.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:49.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 437 2024-09-14T21:33:49.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:49.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:49.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:49.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:49.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:49.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:49.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:50.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 436 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:50.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:50.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 439 2024-09-14T21:33:50.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:51.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 438 2024-09-14T21:33:51.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:51.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:51.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:51.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:51.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:51.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:51.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:51.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:51.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 441 2024-09-14T21:33:51.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:52.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 440 2024-09-14T21:33:52.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:52.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:52.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:52.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 443 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:52.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:52.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 442 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:53.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:53.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:53.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:53.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:53.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:53.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:53.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:53.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:53.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 445 2024-09-14T21:33:53.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:54.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 444 2024-09-14T21:33:54.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:54.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:54.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:54.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:54.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:54.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:54.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:54.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 447 2024-09-14T21:33:54.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:54.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:54.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:33:54.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:54.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:54.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:33:54.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:55.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:55.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 446 2024-09-14T21:33:55.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:55.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 449 2024-09-14T21:33:55.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:55.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:55.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:33:55.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:55.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:55.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:33:55.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:33:56.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 448 2024-09-14T21:33:56.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:33:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:33:56.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:33:56.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 451 2024-09-14T21:33:56.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:56.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:33:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:33:56.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:33:57.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 450 2024-09-14T21:33:57.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:57.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 453 2024-09-14T21:33:57.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:57.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:57.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:33:57.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:57.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:57.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:33:57.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:33:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:33:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:33:57.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:33:58.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 452 2024-09-14T21:33:58.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:58.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:33:58.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:58.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:58.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:33:58.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:33:58.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:58.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:58.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:33:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:33:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:33:58.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 455 2024-09-14T21:33:58.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:59.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 454 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:33:59.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:33:59.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:33:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:33:59.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:33:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:33:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:33:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:33:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:33:59.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 457 2024-09-14T21:33:59.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:00.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:00.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:00.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:00.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:00.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:00.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 456 2024-09-14T21:34:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:00.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:00.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 459 2024-09-14T21:34:00.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:01.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 458 2024-09-14T21:34:01.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:01.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:01.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:01.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:01.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:01.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:01.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:01.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 461 2024-09-14T21:34:01.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:01.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:01.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:01.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:01.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:01.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:01.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:02.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 460 2024-09-14T21:34:02.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:02.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 463 2024-09-14T21:34:02.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:02.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:02.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:02.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:02.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:02.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:02.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:02.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:03.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 462 2024-09-14T21:34:03.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:03.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:03.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:03.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:03.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:03.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:03.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:03.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 465 2024-09-14T21:34:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:03.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:03.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:04.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 464 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:04.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:04.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:04.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:04.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 467 2024-09-14T21:34:04.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:05.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 466 2024-09-14T21:34:05.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 470 2024-09-14T21:34:05.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:06.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 468 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:06.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:06.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 471 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:06.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:07.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 469 2024-09-14T21:34:07.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 473 2024-09-14T21:34:07.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:07.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:07.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:07.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:07.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:07.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:07.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:07.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:07.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:07.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:08.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 472 2024-09-14T21:34:08.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:08.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:08.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:08.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:08.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:08.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:08.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:08.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 475 2024-09-14T21:34:08.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:08.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:09.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 474 2024-09-14T21:34:09.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:09.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:09.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:09.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:09.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:09.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:09.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:09.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:09.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:09.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:09.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:09.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:09.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:09.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 477 2024-09-14T21:34:09.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:10.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:10.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:10.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:10.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:10.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:10.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:10.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:10.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:10.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:10.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:10.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:10.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:10.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 476 2024-09-14T21:34:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:10.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 479 2024-09-14T21:34:10.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 478 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:11.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:11.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 481 2024-09-14T21:34:11.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:11.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:11.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:11.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:11.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:11.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:11.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:12.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 480 2024-09-14T21:34:12.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:12.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 483 2024-09-14T21:34:12.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:12.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:12.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:13.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 482 2024-09-14T21:34:13.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:13.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 485 2024-09-14T21:34:13.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:13.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:13.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:13.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:13.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:14.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 484 2024-09-14T21:34:14.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 487 2024-09-14T21:34:14.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:15.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 486 2024-09-14T21:34:15.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:15.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:15.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:15.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:15.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:15.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:15.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 489 2024-09-14T21:34:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:16.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 488 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:16.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:16.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:16.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:16.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:16.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:16.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:16.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:16.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 491 2024-09-14T21:34:16.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:17.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 490 2024-09-14T21:34:17.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:17.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:17.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 493 2024-09-14T21:34:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:18.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 492 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:18.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:18.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:18.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:18.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:18.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:18.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:18.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:18.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 495 2024-09-14T21:34:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:19.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 494 2024-09-14T21:34:19.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:19.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:19.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:19.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 497 2024-09-14T21:34:19.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:20.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:20.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:20.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:20.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:20.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:20.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:20.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 496 2024-09-14T21:34:20.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:20.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 499 2024-09-14T21:34:20.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:20.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:20.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:20.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:20.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:20.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:20.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:21.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 498 2024-09-14T21:34:21.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:21.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:21.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:21.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:21.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:21.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:21.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:21.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:21.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:21.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:21.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:21.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:21.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:21.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 501 2024-09-14T21:34:21.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:22.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 500 2024-09-14T21:34:22.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:22.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 503 2024-09-14T21:34:22.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:23.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 502 2024-09-14T21:34:23.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:23.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:23.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:23.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:23.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 505 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:23.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:24.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 504 2024-09-14T21:34:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:24.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:24.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:24.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:24.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:24.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 507 2024-09-14T21:34:24.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:25.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 506 2024-09-14T21:34:25.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:25.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:25.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:25.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 509 2024-09-14T21:34:25.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:26.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 508 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:26.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:26.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:26.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:26.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 511 2024-09-14T21:34:26.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:27.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 510 2024-09-14T21:34:27.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:27.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 513 2024-09-14T21:34:27.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:27.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:27.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:27.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:28.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 512 2024-09-14T21:34:28.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:28.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:28.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:28.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:28.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:28.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:28.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:28.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 515 2024-09-14T21:34:28.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:28.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:28.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:28.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:28.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:28.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:28.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:29.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 514 2024-09-14T21:34:29.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:29.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:29.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 517 2024-09-14T21:34:29.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:30.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:30.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:30.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:30.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:30.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:30.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:30.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 516 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:30.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:30.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 519 2024-09-14T21:34:30.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:31.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 518 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:31.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:31.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 521 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:31.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:32.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 520 2024-09-14T21:34:32.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:32.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 523 2024-09-14T21:34:32.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:32.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:32.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:32.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:32.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:32.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:32.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 522 2024-09-14T21:34:33.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:33.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:33.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:33.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:33.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:33.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:33.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 525 2024-09-14T21:34:33.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:33.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:34.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 524 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:34.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:34.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 527 2024-09-14T21:34:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:34.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:35.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:35.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:35.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 526 2024-09-14T21:34:35.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:35.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 529 2024-09-14T21:34:35.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:36.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 528 2024-09-14T21:34:36.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:36.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:36.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:36.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:36.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:36.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:36.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:36.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 531 2024-09-14T21:34:36.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:37.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 530 2024-09-14T21:34:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:37.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 533 2024-09-14T21:34:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:37.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:37.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:37.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:37.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:37.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:37.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:37.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 532 2024-09-14T21:34:38.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:38.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:38.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:38.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:38.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:38.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:38.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:38.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:38.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:38.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 535 2024-09-14T21:34:38.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:39.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 534 2024-09-14T21:34:39.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:39.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:39.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:39.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:39.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:39.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:39.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:39.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 537 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:39.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:39.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:40.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:40.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 536 2024-09-14T21:34:40.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:40.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 539 2024-09-14T21:34:40.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:41.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 538 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:41.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 541 2024-09-14T21:34:41.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:42.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 540 2024-09-14T21:34:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:42.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 543 2024-09-14T21:34:42.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:42.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:42.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:42.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:42.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:42.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:42.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:42.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:43.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 542 2024-09-14T21:34:43.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:43.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 545 2024-09-14T21:34:43.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:43.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:44.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 544 2024-09-14T21:34:44.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:44.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 547 2024-09-14T21:34:44.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:44.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:44.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:44.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:44.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:44.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:44.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:45.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 546 2024-09-14T21:34:45.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:45.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:45.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:45.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:45.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:45.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:45.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:45.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 549 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:45.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:45.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:46.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 548 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:46.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:46.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 551 2024-09-14T21:34:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:47.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 550 2024-09-14T21:34:47.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:47.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:47.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 553 2024-09-14T21:34:47.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:48.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 552 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:48.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:48.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:48.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:48.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 555 2024-09-14T21:34:48.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:49.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:49.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 554 2024-09-14T21:34:49.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:49.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 557 2024-09-14T21:34:49.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:49.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:50.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 556 2024-09-14T21:34:50.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:50.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 559 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:50.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:51.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 558 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:51.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:51.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:51.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 561 2024-09-14T21:34:51.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:51.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:51.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:51.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:51.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:51.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:51.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:52.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 560 2024-09-14T21:34:52.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:52.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 564 2024-09-14T21:34:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:52.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:52.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:52.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:52.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:52.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:52.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:52.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:53.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 562 2024-09-14T21:34:53.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:53.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:53.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:53.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:53.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:53.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:53.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 565 2024-09-14T21:34:53.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:53.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:53.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:53.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:53.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:53.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:53.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 563 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:54.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:54.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:54.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 567 2024-09-14T21:34:54.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:34:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:34:54.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:34:54.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:55.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:55.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:55.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:55.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:55.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:55.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:55.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 566 2024-09-14T21:34:55.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:55.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:34:55.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:55.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:55.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:34:55.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:34:55.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:55.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 569 2024-09-14T21:34:55.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:56.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 568 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:34:56.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:34:56.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:56.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 571 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:34:56.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:34:56.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:57.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 570 2024-09-14T21:34:57.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:57.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 573 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:34:57.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:34:57.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:34:58.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 572 2024-09-14T21:34:58.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:58.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:34:58.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:58.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:58.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:34:58.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:34:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:58.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 575 2024-09-14T21:34:58.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:58.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:34:58.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:58.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:58.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:34:58.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:34:58.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:59.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 574 2024-09-14T21:34:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:59.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:34:59.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:59.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:59.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:34:59.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:34:59.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:34:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:34:59.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 577 2024-09-14T21:34:59.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:00.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:00.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:00.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 576 2024-09-14T21:35:00.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:00.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:00.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 579 2024-09-14T21:35:00.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:01.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 578 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:01.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:01.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:01.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:01.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:01.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:01.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:01.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:01.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:01.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 581 2024-09-14T21:35:01.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:02.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 580 2024-09-14T21:35:02.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:02.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 583 2024-09-14T21:35:02.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:02.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:02.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:03.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 582 2024-09-14T21:35:03.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:03.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 585 2024-09-14T21:35:03.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:35:03.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:35:04.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 584 2024-09-14T21:35:04.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:04.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 587 2024-09-14T21:35:04.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:04.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:04.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:04.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:05.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 586 2024-09-14T21:35:05.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:05.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 589 2024-09-14T21:35:05.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:05.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:06.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 588 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:06.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:06.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:06.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 591 2024-09-14T21:35:06.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:06.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:06.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:06.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:06.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:06.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:06.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:07.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 590 2024-09-14T21:35:07.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:07.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:07.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 593 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:07.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:08.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 592 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:08.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:08.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:08.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 595 2024-09-14T21:35:08.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:09.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 594 2024-09-14T21:35:09.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:35:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:35:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:35:09.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:09.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:09.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 597 2024-09-14T21:35:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:10.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 596 2024-09-14T21:35:10.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 599 2024-09-14T21:35:10.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:11.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 598 2024-09-14T21:35:11.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:11.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:11.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:11.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:11.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:11.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:11.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:11.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 601 2024-09-14T21:35:11.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:11.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:11.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:12.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 600 2024-09-14T21:35:12.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:12.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 603 2024-09-14T21:35:12.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:12.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:13.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 602 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:13.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:13.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 605 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:35:13.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:35:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:14.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 604 2024-09-14T21:35:14.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:14.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:14.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:14.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 607 2024-09-14T21:35:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:15.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 606 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:15.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:15.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:15.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 609 2024-09-14T21:35:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:16.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 608 2024-09-14T21:35:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:16.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:16.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:16.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:16.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 611 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:16.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:16.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:17.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 610 2024-09-14T21:35:17.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:17.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 613 2024-09-14T21:35:17.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:17.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:17.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:17.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:17.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:17.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:18.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 612 2024-09-14T21:35:18.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:18.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:18.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:18.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:18.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:18.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:18.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:18.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 615 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:18.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:18.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:19.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 614 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:35:19.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:35:19.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:19.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 617 2024-09-14T21:35:19.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:20.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:20.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:20.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 616 2024-09-14T21:35:20.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:20.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 619 2024-09-14T21:35:20.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:21.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 618 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:21.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:21.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 621 2024-09-14T21:35:21.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:21.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:21.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:21.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:21.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:21.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:21.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 620 2024-09-14T21:35:22.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:22.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 623 2024-09-14T21:35:22.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:22.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:22.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:22.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:22.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:22.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:22.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:23.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 622 2024-09-14T21:35:23.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:23.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 625 2024-09-14T21:35:23.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:23.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:23.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:23.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:35:23.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:23.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:23.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:35:23.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:35:24.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 624 2024-09-14T21:35:24.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:24.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 627 2024-09-14T21:35:24.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:24.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:35:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:35:25.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 626 2024-09-14T21:35:25.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:25.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:25.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:25.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:25.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:25.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:25.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:25.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 629 2024-09-14T21:35:25.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:25.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:35:25.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:35:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:35:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:26.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 628 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:26.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:26.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:35:26.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:35:26.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 631 2024-09-14T21:35:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:27.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 630 2024-09-14T21:35:27.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:27.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:27.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 633 2024-09-14T21:35:27.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:35:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:27.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:27.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:35:27.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:35:28.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 632 2024-09-14T21:35:28.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:28.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:28.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:28.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:28.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:28.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:28.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:28.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:28.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:35:28.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:28.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:28.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:35:28.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:35:28.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 635 2024-09-14T21:35:28.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:29.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 634 2024-09-14T21:35:29.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:29.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47460 2024-09-14T21:35:29.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:35:29.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:35:29.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 637 2024-09-14T21:35:29.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 636 2024-09-14T21:35:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:30.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47592 2024-09-14T21:35:30.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:30.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:30.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:35:30.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:30.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:30.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:35:30.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:35:31.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 638 2024-09-14T21:35:31.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:31.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47724 2024-09-14T21:35:31.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:35:31.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:35:32.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 639 2024-09-14T21:35:32.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:32.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47876 2024-09-14T21:35:32.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:35:32.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:35:32.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:35:32.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:35:32.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:35:32.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:35:33.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 640 2024-09-14T21:35:33.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:33.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48029 2024-09-14T21:35:33.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:34.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 641 2024-09-14T21:35:34.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:34.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48182 2024-09-14T21:35:34.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:35.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:35.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48335 2024-09-14T21:35:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 642 2024-09-14T21:35:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:35:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:36.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48508 2024-09-14T21:35:37.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:35:37.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48682 2024-09-14T21:35:38.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:35:38.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:35:38.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47329 2024-09-14T21:38:04.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:04.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:04.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:04.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47461 2024-09-14T21:38:05.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:05.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:05.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:05.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47593 2024-09-14T21:38:05.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:05.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:05.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:05.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47725 2024-09-14T21:38:06.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:06.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:06.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:06.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 47877 2024-09-14T21:38:07.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:07.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:07.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:07.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48030 2024-09-14T21:38:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48183 2024-09-14T21:38:09.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:09.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:09.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:09.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48336 2024-09-14T21:38:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48509 2024-09-14T21:38:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:38:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 48683 2024-09-14T21:38:13.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:38:13.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:38:13.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:38:13.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T21:38:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T21:38:13.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T21:38:13.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T21:38:13.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T21:38:13.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54635 2024-09-14T21:38:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T21:38:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T21:38:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T21:38:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T21:38:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:38:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T21:38:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:38:13.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:38:14.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:38:14.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:38:14.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:38:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:38:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:38:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:38:14.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:38:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:38:14.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:39:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=e69652ec1e40ce18a0648c39ded9e16e 2024-09-14T21:39:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T21:39:07.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T21:39:07.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:07.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:07.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:07.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T21:39:08.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=8be10f5bfaad488c50de518aec8787f7 2024-09-14T21:39:08.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T21:39:08.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:08.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:08.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:08.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:08.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T21:39:08.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:08.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:08.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:08.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T21:39:08.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ea01c00c2d725097c31d21495815244c 2024-09-14T21:39:08.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T21:39:08.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=da8d7dbbde7c504decbcc865acd83e0b 2024-09-14T21:39:08.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T21:39:08.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T21:39:08.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:08.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:08.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:08.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T21:39:09.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T21:39:09.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:09.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:09.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:09.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T21:39:09.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:09.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:09.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:09.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:09.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T21:39:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:09.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:09.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:09.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:09.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:09.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T21:39:09.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:09.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:09.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:09.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:39:09.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:09.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:09.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:09.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:09.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:09.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c9a5d63e102abbdb3f1473ea761b662a 2024-09-14T21:39:09.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T21:39:10.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T21:39:10.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:10.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:10.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:10.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:10.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:10.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:39:10.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:10.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:10.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:10.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:10.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:10.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:10.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:39:10.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:10.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:10.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:10.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:10.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:10.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:10.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:10.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:10.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a10b59372cfd1f9e7ce232b7d66496e8 2024-09-14T21:39:10.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T21:39:10.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=50388c7e46b555c5ff4f44df61323da3 2024-09-14T21:39:10.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T21:39:11.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=bbdafeed553c0fc6e5800251c1b7b39d 2024-09-14T21:39:11.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T21:39:11.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T21:39:11.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:11.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T21:39:11.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T21:39:11.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T21:39:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a059284cdd2796d5bd4503a31109de0c 2024-09-14T21:39:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T21:39:11.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T21:39:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T21:39:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T21:39:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:11.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T21:39:11.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:11.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:11.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:11.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:11.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T21:39:11.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T21:39:11.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:11.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:11.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=455a3fc40ff20ed5d1b53cb22127a494 2024-09-14T21:39:11.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:11.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:39:11.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:11.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:11.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:11.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:11.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:11.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:11.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:11.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:12.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:39:12.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T21:39:12.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:12.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:12.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:39:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:39:12.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:39:12.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:12.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:12.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:12.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:12.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:12.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:12.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:39:12.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:12.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:12.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:12.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:12.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:12.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:12.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:12.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:12.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:12.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:12.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:13.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:13.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:14.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:14.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:14.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:39:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:14.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:14.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:14.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:14.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:14.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:39:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:14.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:14.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:14.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:14.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:14.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:14.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:14.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:14.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:14.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:39:14.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:14.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:14.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:14.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:14.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:14.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:14.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:14.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:14.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:14.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:14.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:14.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:14.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:14.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:14.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:14.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:14.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:14.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:14.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:14.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:14.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:14.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:14.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:14.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:14.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:15.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:39:15.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:15.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:15.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:15.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:15.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:15.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:15.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:15.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:15.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:15.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:39:15.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:15.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:15.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:15.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:15.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:15.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:15.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:16.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:16.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:16.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:39:16.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:16.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:16.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:16.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:16.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:16.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:16.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:39:16.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:16.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:16.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:16.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:16.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:16.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:16.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:16.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:16.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:16.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:16.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:18.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:18.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:18.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:18.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:39:18.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:18.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:18.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:18.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:18.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:39:18.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:18.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:18.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:18.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:18.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:18.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:18.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:18.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:18.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:18.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:18.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:18.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:18.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:18.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:18.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:18.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:18.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:18.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:18.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:18.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:18.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:18.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:19.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:19.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:19.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:39:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:19.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:19.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:19.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:19.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:19.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:19.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:23.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:23.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:39:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:23.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:23.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:23.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:24.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:24.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:24.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:24.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:39:24.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:24.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:24.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:24.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:39:24.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:24.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:24.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:24.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:24.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:24.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:24.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:24.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:24.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:24.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:24.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:24.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:24.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:24.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:24.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:24.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:26.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:26.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:26.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:26.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:26.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:39:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:26.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:39:26.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:26.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:26.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:26.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:26.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:26.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:26.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:26.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:26.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:26.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:26.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:26.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:26.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:26.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:26.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:26.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:26.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:26.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:26.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:26.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:26.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:26.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:26.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:26.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:26.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:26.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:26.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:26.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:26.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:26.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:26.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:26.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:26.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:26.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:26.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:26.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:26.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:26.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:26.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:26.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:26.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:26.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:27.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:27.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:27.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:27.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:27.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:39:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:39:27.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:39:27.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:27.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:01' 2024-09-14T21:39:27.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:27.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:39:27.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:27.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:39:32.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:32.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:32.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:32.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:32.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:32.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:32.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:32.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:32.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:32.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:32.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:32.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:32.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:32.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:32.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:32.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:32.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:32.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:32.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:32.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:32.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:32.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:32.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:39:32.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:32.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:39:32.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:32.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:32.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:32.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:32.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:32.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:32.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:32.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:39:32.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:32.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:32.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:32.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:32.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:32.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:32.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:32.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:39:32.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:32.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:32.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:32.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:32.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:32.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:32.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:32.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:32.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:32.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:33.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:33.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:33.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:33.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:33.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:33.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:33.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:33.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:33.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:33.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:33.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:33.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:39:33.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:33.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:33.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:39:33.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:39:33.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:39:33.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:33.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:33.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:33.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:33.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:33.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:33.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:33.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:39:33.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T21:39:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:33.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:39:33.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:33.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T21:39:33.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:33.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:33.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:33.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:33.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:33.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:33.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:33.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:33.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:33.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:33.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:33.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:33.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:33.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:33.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:33.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:33.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:33.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:33.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:33.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:33.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:33.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:33.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:33.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:39:33.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:33.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:39:33.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:33.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:33.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T21:39:33.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T21:39:34.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T21:39:34.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:39:34.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:34.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T21:39:34.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T21:39:34.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T21:39:34.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:34.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:34.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:34.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:39:34.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:39:34.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:34.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:34.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:34.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:34.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:39:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:34.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:39:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:39:34.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:39:34.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:34.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:34.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:34.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:34.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T21:39:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:34.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T21:39:34.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:34.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:34.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:39:34.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:39:34.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:34.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:34.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:34.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T21:39:34.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:34.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:39:34.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:34.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T21:39:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:34.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:39:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:39:34.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:34.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:34.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:34.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:34.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:34.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:34.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:34.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:34.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:34.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:34.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:34.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:34.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:34.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:34.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:34.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:34.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:34.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:34.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:34.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:35.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:35.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:35.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:35.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:35.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:35.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:35.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:35.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:35.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:35.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T21:39:35.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:35.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:35.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:35.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T21:39:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:35.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:35.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:35.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:35.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T21:39:35.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:35.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:39:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:35.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:35.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:39:35.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:39:35.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:35.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:39:35.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:35.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:39:35.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:35.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:35.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:35.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:39:35.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:35.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:35.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:35.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:35.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:35.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:35.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:35.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:35.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:35.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:39:35.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T21:39:35.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:39:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:39:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:35.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:39:35.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:35.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:35.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T21:39:35.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:35.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:39:35.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:35.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:35.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:35.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:35.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T21:39:35.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:39:35.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:35.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:35.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:35.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:35.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:35.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:35.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:35.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:35.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:35.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:35.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:35.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:39:36.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:39:36.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:36.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:39:36.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:39:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T21:39:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T21:39:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T21:39:36.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T21:39:36.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:36.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:36.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:36.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:36.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:36.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:36.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:36.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:36.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:36.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:36.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:36.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:36.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:39:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:39:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:36.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:36.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:36.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:36.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:36.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:36.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:36.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:36.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:36.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:36.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:36.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:36.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:36.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:36.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:36.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:36.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:36.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:36.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:36.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:36.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:36.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:36.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:36.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:36.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:36.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:36.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:36.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:36.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:36.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:39:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:39:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:36.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:36.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T21:39:36.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:39:36.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:39:36.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:39:36.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:36.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:36.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:39:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T21:39:36.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:36.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:36.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T21:39:36.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:39:36.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:39:36.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:36.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:36.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:39:36.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:36.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:36.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:36.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:36.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:36.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:37.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:39:37.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:37.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T21:39:37.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:37.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:37.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:37.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:37.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:37.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:39:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:37.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:37.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T21:39:37.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:39:37.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:39:37.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:39:37.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:39:37.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:39:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:39:31' 2024-09-14T21:39:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:39:37.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:39:37.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:39:37.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:39:37.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:39:37.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:37.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:39:37.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:37.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:39:37.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:39:37.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:39:37.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 21:39:31' 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:39:31' 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:39:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:39:37.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:39:31' 2024-09-14T21:39:37.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:39:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:39:37.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:39:31' 2024-09-14T21:39:37.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:39:37.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:39:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:39:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:39:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:39:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T21:39:38.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:39:38.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T21:39:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T21:39:38.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T21:39:38.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T21:39:38.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T21:39:38.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:39:38.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:39:38.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T21:39:38.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T21:39:38.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:39:38.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T21:39:38.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:39:38.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T21:39:38.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:39:38.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T21:39:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:39:38.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T21:39:38.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:39:38.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T21:39:38.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:39:38.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:40:27.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=da8d7dbbde7c504decbcc865acd83e0b 2024-09-14T21:40:27.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T21:40:27.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=8be10f5bfaad488c50de518aec8787f7 2024-09-14T21:40:27.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T21:40:27.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ da8d7dbbde7c504decbcc865acd83e0b != \d\a\8\d\7\d\b\b\d\e\7\c\5\0\4\d\e\c\b\c\c\8\6\5\a\c\d\8\3\e\0\b ]] 2024-09-14T21:40:27.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 8be10f5bfaad488c50de518aec8787f7 != \8\b\e\1\0\f\5\b\f\a\a\d\4\8\8\c\5\0\d\e\5\1\8\a\e\c\8\7\8\7\f\7 ]] 2024-09-14T21:40:27.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=e69652ec1e40ce18a0648c39ded9e16e 2024-09-14T21:40:27.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T21:40:28.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ e69652ec1e40ce18a0648c39ded9e16e != \e\6\9\6\5\2\e\c\1\e\4\0\c\e\1\8\a\0\6\4\8\c\3\9\d\e\d\9\e\1\6\e ]] 2024-09-14T21:40:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ea01c00c2d725097c31d21495815244c 2024-09-14T21:40:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T21:40:29.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ea01c00c2d725097c31d21495815244c != \e\a\0\1\c\0\0\c\2\d\7\2\5\0\9\7\c\3\1\d\2\1\4\9\5\8\1\5\2\4\4\c ]] 2024-09-14T21:40:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a10b59372cfd1f9e7ce232b7d66496e8 2024-09-14T21:40:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T21:40:31.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c9a5d63e102abbdb3f1473ea761b662a 2024-09-14T21:40:31.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T21:40:31.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a10b59372cfd1f9e7ce232b7d66496e8 != \a\1\0\b\5\9\3\7\2\c\f\d\1\f\9\e\7\c\e\2\3\2\b\7\d\6\6\4\9\6\e\8 ]] 2024-09-14T21:40:31.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c9a5d63e102abbdb3f1473ea761b662a != \c\9\a\5\d\6\3\e\1\0\2\a\b\b\d\b\3\f\1\4\7\3\e\a\7\6\1\b\6\6\2\a ]] 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54636 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54638 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54640 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54642 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:31.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54644 2024-09-14T21:40:32.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=50388c7e46b555c5ff4f44df61323da3 2024-09-14T21:40:32.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T21:40:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 50388c7e46b555c5ff4f44df61323da3 != \5\0\3\8\8\c\7\e\4\6\b\5\5\5\c\5\f\f\4\f\4\4\d\f\6\1\3\2\3\d\a\3 ]] 2024-09-14T21:40:32.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=bbdafeed553c0fc6e5800251c1b7b39d 2024-09-14T21:40:32.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T21:40:32.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ bbdafeed553c0fc6e5800251c1b7b39d != \b\b\d\a\f\e\e\d\5\5\3\c\0\f\c\6\e\5\8\0\0\2\5\1\c\1\b\7\b\3\9\d ]] 2024-09-14T21:40:32.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a059284cdd2796d5bd4503a31109de0c 2024-09-14T21:40:32.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T21:40:32.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=455a3fc40ff20ed5d1b53cb22127a494 2024-09-14T21:40:32.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T21:40:32.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a059284cdd2796d5bd4503a31109de0c != \a\0\5\9\2\8\4\c\d\d\2\7\9\6\d\5\b\d\4\5\0\3\a\3\1\1\0\9\d\e\0\c ]] 2024-09-14T21:40:32.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:32.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54646 2024-09-14T21:40:32.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 455a3fc40ff20ed5d1b53cb22127a494 != \4\5\5\a\3\f\c\4\0\f\f\2\0\e\d\5\d\1\b\5\3\c\b\2\2\1\2\7\a\4\9\4 ]] 2024-09-14T21:40:32.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:32.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54648 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54651 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 54652 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:32.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:32.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:32.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:33.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:33.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:33.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:40:33.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cd6ea116-bb6a-413b-a935-03c4d12441cd 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3230924.8,"bytes_per_snapshot":64618496.0,"last_snapshot_bytes":64618496,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:33.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:33.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:33.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:33.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3230924.8,"bytes_per_snapshot":64618496.0,"last_snapshot_bytes":64618496,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:33.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:33.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:33.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:33.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:33.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:33.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:33.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:33.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:33.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cd6ea116-bb6a-413b-a935-03c4d12441cdup+replayingreplaying, {"bytes_per_second":3230924.8,"bytes_per_snapshot":64618496.0,"last_snapshot_bytes":64618496,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+replayingreplaying, {"bytes_per_second":3235635.2,"bytes_per_snapshot":64712704.0,"last_snapshot_bytes":64712704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349973,"remote_snapshot_timestamp":1726349973,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+replayingreplaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+replayingreplaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+replayingreplaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:33.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:40:33.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:33.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:40:33.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:33.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:33.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T21:40:33.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T21:40:34.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:34.101+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58873c680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:34.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:34.101+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb680 [3/cd6ea116-bb6a-413b-a935-03c4d12441cd] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:35.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:35.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T21:40:35.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:35.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:35.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:40:35.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:35.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:35.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T21:40:35.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:35.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:36.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:36.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:36.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:40:36.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:40:36.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ee42f86b-2f83-49dd-af44-a4bf8bdf26d0 2024-09-14T21:40:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3235635.2,"bytes_per_snapshot":64712704.0,"last_snapshot_bytes":64712704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349973,"remote_snapshot_timestamp":1726349973,"replay_state":"idle"} 2024-09-14T21:40:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:36.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:36.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3235635.2,"bytes_per_snapshot":64712704.0,"last_snapshot_bytes":64712704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349973,"remote_snapshot_timestamp":1726349973,"replay_state":"idle"} 2024-09-14T21:40:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:36.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:36.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:36.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:36.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:36.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:36.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary2ee42f86b-2f83-49dd-af44-a4bf8bdf26d0up+replayingreplaying, {"bytes_per_second":3235635.2,"bytes_per_snapshot":64712704.0,"last_snapshot_bytes":64712704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349973,"remote_snapshot_timestamp":1726349973,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+replayingreplaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+replayingreplaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+replayingreplaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:36.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:36.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:40:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:40:36.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:36.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T21:40:36.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T21:40:36.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:36.770+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58bc0b040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:36.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:36.770+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/ee42f86b-2f83-49dd-af44-a4bf8bdf26d0] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:38.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:38.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:38.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T21:40:38.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:38.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T21:40:38.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:38.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:40:38.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T21:40:38.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:38.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:39.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T21:40:39.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:39.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:39.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:39.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:39.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:39.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:39.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:39.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:39.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 30f05f60-d396-4375-97d2-3088a9415ccb 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"} 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:39.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:39.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"} 2024-09-14T21:40:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:39.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:39.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:39.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:39.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:39.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:39.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary330f05f60-d396-4375-97d2-3088a9415ccbup+replayingreplaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+replayingreplaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+replayingreplaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:39.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:39.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:40:39.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:39.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:40:39.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:39.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:39.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:39.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:39.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:39.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:39.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T21:40:39.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:39.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:39.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:39.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T21:40:39.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T21:40:39.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:39.779+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7676c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:39.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:39.779+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/30f05f60-d396-4375-97d2-3088a9415ccb] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:41.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:41.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T21:40:41.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:41.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:41.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:40:41.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:41.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:41.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T21:40:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:41.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:42.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:42.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:42.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 72e76d0e-86df-414b-b7c0-bfa0639e54c8 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:42.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:42.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:42.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:42.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:42.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:42.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:42.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:42.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:42.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:42.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:42.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:42.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:42.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:42.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:42.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:42.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:42.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:42.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:42.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary472e76d0e-86df-414b-b7c0-bfa0639e54c8up+replayingreplaying, {"bytes_per_second":3290931.2,"bytes_per_snapshot":65818624.0,"last_snapshot_bytes":65818624,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+replayingreplaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:42.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:42.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:40:42.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:42.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:40:42.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:42.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:42.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:42.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:42.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:42.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:42.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T21:40:42.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:42.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:42.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:42.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T21:40:42.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T21:40:42.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:42.828+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5886aa1a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:42.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:42.828+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/72e76d0e-86df-414b-b7c0-bfa0639e54c8] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:44.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:44.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T21:40:44.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:44.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:44.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:40:44.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:44.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:44.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T21:40:44.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:44.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T21:40:44.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:44.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:40:44.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T21:40:44.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:44.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:44.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:45.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:45.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:40:45.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fb48c99c-050e-4300-ac08-f7c792160e2c 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:45.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:45.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:45.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:45.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:45.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:45.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:45.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:45.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:45.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:45.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:45.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:45.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:45.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:45.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary5fb48c99c-050e-4300-ac08-f7c792160e2cup+replayingreplaying, {"bytes_per_second":3320012.8,"bytes_per_snapshot":66400256.0,"last_snapshot_bytes":66400256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:45.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:45.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:40:45.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:45.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:40:45.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:45.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:45.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:45.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:45.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:45.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:45.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T21:40:45.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:45.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:45.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:45.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T21:40:45.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T21:40:46.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:46.065+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b587922b60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:46.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:46.065+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcac80 [3/fb48c99c-050e-4300-ac08-f7c792160e2c] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:47.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:47.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T21:40:47.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:47.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:47.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:40:47.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:47.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:47.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T21:40:47.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:47.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T21:40:47.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:47.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:40:47.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:48.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:48.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:40:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:40:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 76ac538e-da2f-4809-acd0-4edac8f5f212 2024-09-14T21:40:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:48.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:48.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:48.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:48.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:48.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:48.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:48.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:48.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:48.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:48.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:48.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:48.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:48.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary676ac538e-da2f-4809-acd0-4edac8f5f212up+replayingreplaying, {"bytes_per_second":3182796.8,"bytes_per_snapshot":63655936.0,"last_snapshot_bytes":63655936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:48.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:48.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:40:48.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:48.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:40:48.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:48.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:48.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:48.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:48.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T21:40:48.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T21:40:49.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:49.162+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5879221a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:49.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:49.162+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaf00 [3/76ac538e-da2f-4809-acd0-4edac8f5f212] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:50.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:50.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T21:40:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:40:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:50.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T21:40:50.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:50.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T21:40:50.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:50.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:50.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:51.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:51.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:51.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:51.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:40:52.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:40:52.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f853f581-9bee-4894-83e3-e98c46061bf4 2024-09-14T21:40:52.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:52.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"} 2024-09-14T21:40:52.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:52.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:52.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:52.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:52.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:52.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"} 2024-09-14T21:40:52.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:52.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:52.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:52.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:52.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:52.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:52.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:52.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:52.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:52.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:52.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:52.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary7f853f581-9bee-4894-83e3-e98c46061bf4up+replayingreplaying, {"bytes_per_second":3176243.2,"bytes_per_snapshot":63524864.0,"last_snapshot_bytes":63524864,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349977,"remote_snapshot_timestamp":1726349977,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:52.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:52.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:40:52.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:52.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:40:52.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:52.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:52.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:52.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:52.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T21:40:52.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T21:40:52.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:52.371+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed4ea0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:52.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:52.372+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/f853f581-9bee-4894-83e3-e98c46061bf4] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:53.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:53.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T21:40:53.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:40:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:53.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T21:40:53.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:53.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:53.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:54.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T21:40:54.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:54.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:54.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:54.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:54.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:54.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:54.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:54.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:54.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:40:54.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:40:54.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1d672076-2c9b-46f8-9ccc-62094a4aca14 2024-09-14T21:40:54.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:54.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:54.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:54.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:54.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:54.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:54.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:54.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"} 2024-09-14T21:40:54.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:54.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:54.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:54.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:54.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:54.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:54.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:54.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:54.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:54.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:54.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:54.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:54.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:54.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:54.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary81d672076-2c9b-46f8-9ccc-62094a4aca14up+replayingreplaying, {"bytes_per_second":3173785.6,"bytes_per_snapshot":63475712.0,"last_snapshot_bytes":63475712,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349974,"remote_snapshot_timestamp":1726349974,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:54.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:54.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:40:54.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:54.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:40:54.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:54.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:54.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:54.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:54.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T21:40:54.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T21:40:55.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:55.042+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed5040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:55.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:55.042+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/1d672076-2c9b-46f8-9ccc-62094a4aca14] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:56.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T21:40:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:40:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T21:40:56.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:56.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:56.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:57.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:57.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:40:57.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b14d28f1-9b97-4339-addd-a485633fcb8a 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:40:57.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:40:57.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:40:57.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:40:57.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:40:57.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:40:57.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:57.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:40:57.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:57.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:40:57.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:40:57.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:40:57.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:40:57.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:40:57.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:40:57.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31image-primary9b14d28f1-9b97-4339-addd-a485633fcb8aup+replayingreplaying, {"bytes_per_second":3313664.0,"bytes_per_snapshot":66273280.0,"last_snapshot_bytes":66273280,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:40:57.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:40:57.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:40:57.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:40:57.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:40:57.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:40:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:40:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:40:57.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:40:57.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:57.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:57.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T21:40:57.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:40:57.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:57.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:57.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T21:40:57.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T21:40:58.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:58.049+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed51e0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:40:58.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:40:58.049+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/b14d28f1-9b97-4339-addd-a485633fcb8a] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:40:59.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:40:59.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:40:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T21:40:59.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:40:59.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T21:40:59.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:40:59.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:40:59.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T21:40:59.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:59.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:40:59.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:41:00.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T21:41:00.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:41:00.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3716c289-18e5-480c-b05a-b3940a693aa6 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:40:31' 2024-09-14T21:41:00.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:41:00.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:41:00.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:41:00.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"} 2024-09-14T21:41:00.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:41:00.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:41:00.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:41:00.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:41:00.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:41:00.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:41:00.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:41:00.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 21:40:31' 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:40:31' 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:41:00.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:41:00.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:41:00.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary103716c289-18e5-480c-b05a-b3940a693aa6up+replayingreplaying, {"bytes_per_second":3246899.2,"bytes_per_snapshot":64937984.0,"last_snapshot_bytes":64937984,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726349978,"remote_snapshot_timestamp":1726349978,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:40:31' 2024-09-14T21:41:00.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:41:00.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:41:00.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:40:31' 2024-09-14T21:41:00.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:41:00.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:41:00.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:41:00.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:41:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:41:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T21:41:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:41:00.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:00.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:00.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T21:41:00.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T21:41:01.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:41:01.075+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed5380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:41:01.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:41:01.075+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/3716c289-18e5-480c-b05a-b3940a693aa6] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:41:01.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:41:01.185+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5886aa9c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:41:01.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:41:01.185+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/3716c289-18e5-480c-b05a-b3940a693aa6] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:41:02.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:41:02.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T21:41:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:41:02.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:41:02.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T21:41:02.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:02.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T21:41:02.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T21:41:02.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T21:41:02.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T21:41:02.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T21:41:02.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T21:41:02.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T21:41:02.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:02.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:02.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T21:41:02.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:02.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:02.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:02.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:02.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T21:41:03.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:03.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T21:41:03.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a4ce0584079 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a4ce0584079 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:02 2024 2024-09-14T21:41:03.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:02 2024 2024-09-14T21:41:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:02 2024 2024-09-14T21:41:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:41:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:03.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:03.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:03.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T21:41:03.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T21:41:03.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:03.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T21:41:03.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 20967eac-b8f0-4d93-aa73-8b5514352836 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:03.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:03.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:03.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T21:41:03.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T21:41:03.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:03.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:03.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:03.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:03.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:03.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:03.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:03.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T21:41:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:03.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:03.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T21:41:04.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:04.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T21:41:04.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:04.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 664 2024-09-14T21:41:04.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T21:41:04.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T21:41:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a5cbf9c3f40 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a5cbf9c3f40 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:03 2024 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:03 2024 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:03 2024 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:41:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:04.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:04.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:04.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T21:41:04.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T21:41:04.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:04.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T21:41:04.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: e8c0d23f-22c8-48bb-8f83-e749c8318997 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:04.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:04.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:04.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:04.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:04.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:04.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:04.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T21:41:04.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T21:41:04.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:04.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T21:41:04.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:04.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:04.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:04.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:04.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:04.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:04.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:04.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T21:41:04.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:04.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:04.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:04.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T21:41:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T21:41:05.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:05.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 666 2024-09-14T21:41:05.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T21:41:05.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a6b8222f4c9 2024-09-14T21:41:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a6b8222f4c9 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:04 2024 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:04 2024 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:04 2024 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:41:05.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T21:41:05.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T21:41:05.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:05.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T21:41:05.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 8294cdfd-f51e-4fef-9a87-bee03fc9d45c 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:05.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:05.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:05.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:05.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:05.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T21:41:05.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T21:41:05.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:05.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T21:41:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:41:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T21:41:05.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T21:41:05.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:05.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T21:41:06.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:06.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T21:41:06.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:06.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 668 2024-09-14T21:41:06.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:06.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a79ee3d0f89 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a79ee3d0f89 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:06.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:05 2024 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:05 2024 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:05 2024 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:41:06.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:06.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:06.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:06.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T21:41:06.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T21:41:06.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:06.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T21:41:06.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:06.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: f4fd27b9-e9e0-4c49-bafa-b5754aa7ea6b 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:06.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:06.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:06.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:06.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T21:41:06.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T21:41:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:06.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T21:41:06.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:06.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T21:41:06.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:06.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T21:41:06.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:06.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:06.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:06.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T21:41:07.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:07.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T21:41:07.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:07.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 670 2024-09-14T21:41:07.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T21:41:07.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:07.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:07.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T21:41:07.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a886636ace 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a886636ace 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:06 2024 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:06 2024 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:06 2024 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:07.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:41:07.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:07.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:07.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:07.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T21:41:07.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T21:41:07.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:07.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T21:41:07.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:07.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:07.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:07.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 8b1a00e6-6cb3-4a3d-857e-42f21a6f372f 2024-09-14T21:41:07.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:07.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:07.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:07.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:07.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:07.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:07.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:07.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T21:41:07.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T21:41:07.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:07.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:07.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:07.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T21:41:07.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T21:41:07.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T21:41:07.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T21:41:07.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:07.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T21:41:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T21:41:08.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:08.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 672 2024-09-14T21:41:08.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 673 2024-09-14T21:41:08.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T21:41:08.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:08.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1a9a7054cff3 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1a9a7054cff3 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:08.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:07 2024 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:07 2024 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:07 2024 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:41:08.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:08.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:08.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:08.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T21:41:08.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T21:41:08.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:08.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T21:41:08.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:08.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:08.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 730eb6ba-7d20-483b-a2fd-203daf623fc4 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:08.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:08.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:08.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:08.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:08.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T21:41:08.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T21:41:08.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:08.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T21:41:08.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:08.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T21:41:08.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T21:41:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:08.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T21:41:09.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:09.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T21:41:09.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:09.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:09.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:09.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:09.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 675 2024-09-14T21:41:09.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 676 2024-09-14T21:41:09.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:09.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:09.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:09.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T21:41:09.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T21:41:09.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:09.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1aacba99adc0 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1aacba99adc0 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:08 2024 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:08 2024 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:08 2024 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:41:09.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:09.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:09.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:09.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T21:41:09.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T21:41:09.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:09.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T21:41:09.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: c6cc8518-4b55-422f-afb4-34ff2064b66c 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:09.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:09.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:09.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T21:41:09.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T21:41:09.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:09.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T21:41:09.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T21:41:10.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:10.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T21:41:10.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:10.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:10.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:10.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:10.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:10.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 678 2024-09-14T21:41:10.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 679 2024-09-14T21:41:10.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T21:41:10.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1abeb911845c 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1abeb911845c 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:10.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:09 2024 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:09 2024 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:09 2024 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:41:10.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:10.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T21:41:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T21:41:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T21:41:10.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 2a2e6e08-0f1a-4ed2-97fa-a3fe7b95a74d 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:10.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:10.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:10.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:10.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:10.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T21:41:10.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T21:41:10.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:10.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T21:41:10.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:10.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:10.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:10.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T21:41:11.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:11.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:11.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:11.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:11.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:11.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 682 2024-09-14T21:41:11.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 681 2024-09-14T21:41:11.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:11.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T21:41:11.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1acef5d70be3 2024-09-14T21:41:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1acef5d70be3 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:10 2024 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:10 2024 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:10 2024 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:41:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:11.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:11.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T21:41:11.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T21:41:11.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:11.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T21:41:11.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:11.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: da85ee39-0451-4e11-8f28-24d6d19b5c3d 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:11.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:11.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:11.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:11.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:11.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T21:41:11.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T21:41:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:11.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T21:41:11.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:11.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:41:11.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T21:41:11.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:41:11.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T21:41:11.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:41:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T21:41:12.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:12.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T21:41:12.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 685 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:12.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:12.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:12.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:12.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 684 2024-09-14T21:41:12.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 686 2024-09-14T21:41:12.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:12.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T21:41:12.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1ae2547b0de1 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1ae2547b0de1 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:41:12.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:41:11 2024 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:41:11 2024 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:41:11 2024 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:41:12.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:41:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:41:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:41:12.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T21:41:12.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T21:41:12.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:41:12.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T21:41:12.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:41:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:41:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:41:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 4b79a49e-9920-4745-82bb-c60e0a2f138b 2024-09-14T21:41:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:41:12.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:41:12.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:12.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:41:12.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:41:12.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:41:13.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:41:13.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:41:13.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T21:41:13.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T21:41:13.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:41:13.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:41:13.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:41:13.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59259 2024-09-14T21:41:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T21:41:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T21:41:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T21:41:13.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:13.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:13.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:13.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:13.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:13.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:13.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 688 2024-09-14T21:41:13.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 690 2024-09-14T21:41:13.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 689 2024-09-14T21:41:13.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:13.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:41:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T21:41:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 691 2024-09-14T21:41:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 692 2024-09-14T21:41:14.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:14.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:14.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:14.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:14.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:14.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:14.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:14.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:15.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:15.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:15.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 693 2024-09-14T21:41:15.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 694 2024-09-14T21:41:15.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:15.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:15.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:15.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:15.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:15.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:15.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:15.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:15.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:15.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:15.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:15.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:16.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 695 2024-09-14T21:41:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 696 2024-09-14T21:41:16.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 697 2024-09-14T21:41:16.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:16.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:16.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:16.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:16.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:16.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:16.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:16.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:16.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:16.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:16.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:16.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:16.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:16.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:17.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 700 2024-09-14T21:41:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 698 2024-09-14T21:41:17.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 699 2024-09-14T21:41:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:17.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:17.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:17.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:17.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:17.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:17.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:17.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:18.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 702 2024-09-14T21:41:18.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 701 2024-09-14T21:41:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:18.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 703 2024-09-14T21:41:19.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 704 2024-09-14T21:41:19.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:19.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:19.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:19.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:19.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:19.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:19.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:19.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:19.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:19.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:20.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:20.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:20.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:20.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:20.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:20.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:20.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 706 2024-09-14T21:41:20.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 705 2024-09-14T21:41:20.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 707 2024-09-14T21:41:20.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:20.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:21.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:21.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 708 2024-09-14T21:41:21.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 710 2024-09-14T21:41:21.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 709 2024-09-14T21:41:21.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:22.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 712 2024-09-14T21:41:22.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 711 2024-09-14T21:41:22.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:22.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:22.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:22.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:23.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 713 2024-09-14T21:41:23.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 714 2024-09-14T21:41:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:23.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:23.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:23.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:23.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:23.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:23.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:23.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:23.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:23.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:23.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 716 2024-09-14T21:41:24.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:24.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 715 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:24.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:24.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:24.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:24.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:24.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:24.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:24.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:24.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:25.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:25.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:25.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:25.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:25.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:25.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:25.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:25.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 719 2024-09-14T21:41:25.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 718 2024-09-14T21:41:25.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:26.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 717 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:26.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:26.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:26.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 721 2024-09-14T21:41:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:27.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 720 2024-09-14T21:41:27.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:27.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:27.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:27.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:27.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:27.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:27.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:27.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:27.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:27.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:27.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:27.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:27.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:27.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 723 2024-09-14T21:41:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:28.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 722 2024-09-14T21:41:28.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:28.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:28.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:28.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:28.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:28.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:28.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:28.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:28.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 725 2024-09-14T21:41:28.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:29.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:29.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 724 2024-09-14T21:41:29.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:29.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 728 2024-09-14T21:41:29.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:30.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:30.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 726 2024-09-14T21:41:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:30.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 729 2024-09-14T21:41:30.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:30.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:30.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:30.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:30.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:30.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:30.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:31.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 727 2024-09-14T21:41:31.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:31.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:31.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:31.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:31.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:31.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:31.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:31.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:31.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 731 2024-09-14T21:41:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:32.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 730 2024-09-14T21:41:32.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:32.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 733 2024-09-14T21:41:32.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:32.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:32.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:32.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:32.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:32.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:32.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:32.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:33.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 732 2024-09-14T21:41:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:33.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:33.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:33.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 735 2024-09-14T21:41:33.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 734 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:34.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 737 2024-09-14T21:41:34.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:34.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:35.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:35.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 736 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:35.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:35.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:35.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 739 2024-09-14T21:41:35.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 738 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:36.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:36.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:36.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:36.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:36.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 741 2024-09-14T21:41:36.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:37.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 740 2024-09-14T21:41:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:37.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 743 2024-09-14T21:41:37.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:38.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 742 2024-09-14T21:41:38.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:38.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:38.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:38.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:38.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:38.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:38.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:38.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:38.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:38.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:38.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:38.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:38.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 745 2024-09-14T21:41:38.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:39.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 744 2024-09-14T21:41:39.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:39.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:39.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:39.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:39.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:39.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 747 2024-09-14T21:41:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:39.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:40.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 746 2024-09-14T21:41:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:40.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:40.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:40.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 749 2024-09-14T21:41:40.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:40.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:40.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:40.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:40.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:40.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:40.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:41.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 748 2024-09-14T21:41:41.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:41.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:41.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 751 2024-09-14T21:41:41.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:41.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:42.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 750 2024-09-14T21:41:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:42.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 753 2024-09-14T21:41:42.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:42.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:43.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 752 2024-09-14T21:41:43.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:43.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 755 2024-09-14T21:41:43.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:43.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:43.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:44.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 754 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:44.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:44.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:44.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 757 2024-09-14T21:41:44.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:44.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:44.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:44.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:44.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:45.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 756 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:45.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:45.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:45.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:45.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 759 2024-09-14T21:41:45.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:46.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 758 2024-09-14T21:41:46.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:46.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 761 2024-09-14T21:41:46.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:46.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:46.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:46.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:46.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:46.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:46.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:47.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 760 2024-09-14T21:41:47.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:47.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 763 2024-09-14T21:41:47.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:47.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:47.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:48.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 762 2024-09-14T21:41:48.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:48.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 765 2024-09-14T21:41:48.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:48.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:48.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:48.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:48.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:48.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:48.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:49.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 764 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:49.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:49.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:49.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:49.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 767 2024-09-14T21:41:49.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:50.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 766 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:50.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:50.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:50.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:50.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 769 2024-09-14T21:41:50.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:51.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 768 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:51.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:51.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:51.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:51.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:51.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:51.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:51.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:51.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:51.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 771 2024-09-14T21:41:51.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:52.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 770 2024-09-14T21:41:52.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:52.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 773 2024-09-14T21:41:52.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:52.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:52.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:52.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:52.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:52.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:52.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:53.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 772 2024-09-14T21:41:53.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:53.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:53.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:53.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:53.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:53.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:53.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:53.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 775 2024-09-14T21:41:53.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:54.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 774 2024-09-14T21:41:54.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:54.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:54.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:54.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:54.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 776 2024-09-14T21:41:54.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 777 2024-09-14T21:41:54.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:54.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:54.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:41:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:41:54.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:55.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:41:55.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 779 2024-09-14T21:41:55.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:41:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:41:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:41:56.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 778 2024-09-14T21:41:56.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:56.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:56.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:41:56.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:41:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:41:56.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 781 2024-09-14T21:41:56.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:41:56.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:41:57.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 780 2024-09-14T21:41:57.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:57.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 783 2024-09-14T21:41:57.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:57.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:57.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:41:57.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:57.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:57.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:41:57.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:41:57.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:41:57.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:41:58.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 782 2024-09-14T21:41:58.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:58.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 786 2024-09-14T21:41:58.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:58.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:41:58.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:58.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:58.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:41:58.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:41:58.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:59.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 784 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:41:59.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:41:59.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:41:59.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:41:59.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:41:59.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:41:59.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:41:59.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:41:59.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:00.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:00.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:00.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:00.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:00.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:00.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:00.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:00.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:00.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:00.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:00.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:00.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:00.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 785 2024-09-14T21:42:00.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 787 2024-09-14T21:42:00.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:00.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:00.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 789 2024-09-14T21:42:00.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:01.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 788 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:01.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:01.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 791 2024-09-14T21:42:01.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:01.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:02.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 790 2024-09-14T21:42:02.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:02.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 793 2024-09-14T21:42:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:02.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:03.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 792 2024-09-14T21:42:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:03.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 795 2024-09-14T21:42:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:03.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:03.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:03.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:03.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:03.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:03.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:04.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 794 2024-09-14T21:42:04.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 797 2024-09-14T21:42:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 796 2024-09-14T21:42:04.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:04.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:04.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:04.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:04.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:04.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:04.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:04.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:04.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:04.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:04.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:05.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:05.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 799 2024-09-14T21:42:05.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:06.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:06.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:06.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:06.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:06.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:06.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:06.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:06.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:06.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:06.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:06.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:06.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:06.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 798 2024-09-14T21:42:06.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:06.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 801 2024-09-14T21:42:06.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:07.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 800 2024-09-14T21:42:07.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:07.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 802 2024-09-14T21:42:07.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:07.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 804 2024-09-14T21:42:07.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:07.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:07.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:07.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:07.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:07.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:07.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:07.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:07.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:07.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:07.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:07.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:07.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:08.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 805 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:08.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:08.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:09.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 803 2024-09-14T21:42:09.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:09.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:09.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:09.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:09.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:09.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:09.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:09.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:09.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:10.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:10.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:10.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:10.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:10.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:10.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:10.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:10.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 807 2024-09-14T21:42:10.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 806 2024-09-14T21:42:10.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:10.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 809 2024-09-14T21:42:10.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:11.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 808 2024-09-14T21:42:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:11.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:11.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:11.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:11.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:11.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:11.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:11.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 811 2024-09-14T21:42:11.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:12.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 810 2024-09-14T21:42:12.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:12.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:12.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:12.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:12.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:12.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:12.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:13.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 812 2024-09-14T21:42:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 813 2024-09-14T21:42:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:13.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:13.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 815 2024-09-14T21:42:13.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:13.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:13.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:13.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:13.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:13.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:13.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:14.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 814 2024-09-14T21:42:14.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 816 2024-09-14T21:42:14.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 817 2024-09-14T21:42:14.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:14.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:14.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:14.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:14.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:14.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:14.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:14.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:15.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:15.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:15.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:15.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:15.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:15.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:15.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 819 2024-09-14T21:42:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:16.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 818 2024-09-14T21:42:16.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:16.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:16.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:16.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:16.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:16.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:16.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:16.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:16.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:16.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:16.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:16.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:16.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:16.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 821 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:16.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:17.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 820 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:17.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 823 2024-09-14T21:42:17.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 822 2024-09-14T21:42:17.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:17.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:17.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:17.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:17.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:17.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:17.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:17.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:17.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:17.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:17.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:17.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:17.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:17.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:18.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:18.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:18.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:18.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:18.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:18.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:18.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 825 2024-09-14T21:42:18.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:19.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 824 2024-09-14T21:42:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:19.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:20.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:20.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:20.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:20.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:20.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 827 2024-09-14T21:42:20.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 826 2024-09-14T21:42:20.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:20.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:20.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:20.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:20.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 829 2024-09-14T21:42:20.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:21.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 828 2024-09-14T21:42:21.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:21.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:21.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 831 2024-09-14T21:42:21.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:22.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 830 2024-09-14T21:42:22.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:22.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:23.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 833 2024-09-14T21:42:23.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 832 2024-09-14T21:42:23.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:23.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:23.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:23.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 835 2024-09-14T21:42:23.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:23.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:23.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:23.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:23.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:23.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:23.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:24.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 834 2024-09-14T21:42:24.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:24.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 837 2024-09-14T21:42:24.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 836 2024-09-14T21:42:24.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:24.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:24.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:24.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:24.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:24.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:24.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:24.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:24.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:25.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 839 2024-09-14T21:42:25.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:26.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 838 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:26.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:26.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:26.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:26.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:26.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:26.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:26.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:26.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 841 2024-09-14T21:42:26.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:26.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:26.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:26.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:26.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:26.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:26.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:27.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 840 2024-09-14T21:42:27.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:27.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 843 2024-09-14T21:42:27.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 842 2024-09-14T21:42:27.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:27.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:27.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:27.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:27.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:27.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:27.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:28.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:28.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:28.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:28.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:28.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:28.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:28.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 845 2024-09-14T21:42:28.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:29.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 844 2024-09-14T21:42:29.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:29.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:29.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:29.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:29.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:29.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:29.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:29.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:29.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:29.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:29.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:29.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:29.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:30.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:30.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:30.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:30.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:30.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:30.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:30.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:30.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:30.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 846 2024-09-14T21:42:30.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 847 2024-09-14T21:42:30.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:30.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:30.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 849 2024-09-14T21:42:30.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:31.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 848 2024-09-14T21:42:31.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:31.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:31.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 851 2024-09-14T21:42:31.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:32.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 850 2024-09-14T21:42:32.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:32.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:33.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 853 2024-09-14T21:42:33.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 852 2024-09-14T21:42:33.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:33.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 855 2024-09-14T21:42:33.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:33.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:33.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:33.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:33.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:33.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:33.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:33.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:33.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:33.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:33.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:33.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:33.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:34.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:34.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 854 2024-09-14T21:42:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:34.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:34.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 857 2024-09-14T21:42:34.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 856 2024-09-14T21:42:34.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:34.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:35.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 858 2024-09-14T21:42:35.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 859 2024-09-14T21:42:35.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:35.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:36.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:36.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:36.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:36.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:36.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:36.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:36.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:36.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:36.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:36.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:36.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:36.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:36.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 861 2024-09-14T21:42:36.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:37.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 860 2024-09-14T21:42:37.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:37.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 863 2024-09-14T21:42:37.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 862 2024-09-14T21:42:37.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:37.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:37.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:37.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:37.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:37.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:37.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:37.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:37.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:37.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:37.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:37.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:37.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:38.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 865 2024-09-14T21:42:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:38.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:38.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:38.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:38.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:38.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:38.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:39.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 864 2024-09-14T21:42:39.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:39.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:40.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:40.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:40.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:40.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:40.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:40.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:40.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:40.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:40.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:40.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:40.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:40.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:40.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:40.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 867 2024-09-14T21:42:40.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 866 2024-09-14T21:42:40.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:41.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 869 2024-09-14T21:42:41.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:41.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:41.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:41.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:41.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:41.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:41.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 868 2024-09-14T21:42:41.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:41.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 870 2024-09-14T21:42:41.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:41.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:41.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 871 2024-09-14T21:42:41.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:42.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:42.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:42.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:42.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:42.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:42.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:42.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 872 2024-09-14T21:42:42.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:43.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 873 2024-09-14T21:42:43.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:43.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 875 2024-09-14T21:42:43.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:43.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:43.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:43.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:43.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:43.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:43.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:43.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:44.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 874 2024-09-14T21:42:44.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 877 2024-09-14T21:42:44.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 876 2024-09-14T21:42:44.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:44.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:44.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:44.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:44.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:44.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:44.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:44.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:44.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:44.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:44.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:44.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:44.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:44.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:44.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:45.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 878 2024-09-14T21:42:45.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 880 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:45.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:45.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:45.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:46.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:46.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:46.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:47.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 881 2024-09-14T21:42:47.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 879 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:47.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:47.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:47.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:47.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:47.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:47.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:47.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:47.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:47.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:47.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:47.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 883 2024-09-14T21:42:47.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:48.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 882 2024-09-14T21:42:48.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:48.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:48.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:48.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 885 2024-09-14T21:42:48.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:49.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 884 2024-09-14T21:42:49.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:50.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 886 2024-09-14T21:42:50.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 887 2024-09-14T21:42:50.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:50.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:50.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:50.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:50.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:50.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:50.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:50.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:50.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:50.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:50.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:50.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:50.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:50.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:50.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:50.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:50.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:50.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:50.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:50.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:51.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 888 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:51.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:51.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 889 2024-09-14T21:42:51.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:51.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:51.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:51.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:51.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:51.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:51.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:51.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:51.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 890 2024-09-14T21:42:51.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 891 2024-09-14T21:42:51.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:51.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:52.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 893 2024-09-14T21:42:52.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:52.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:53.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 892 2024-09-14T21:42:53.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:53.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:53.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:53.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:53.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:53.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:53.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:53.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 895 2024-09-14T21:42:53.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:53.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:53.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:53.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:54.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 894 2024-09-14T21:42:54.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:54.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:54.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:54.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:54.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:54.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:54.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:54.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 896 2024-09-14T21:42:54.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 897 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:54.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:54.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:54.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:54.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:42:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:42:54.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:42:54.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:42:55.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:55.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:42:55.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:55.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:55.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:42:55.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:42:55.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 898 2024-09-14T21:42:55.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:55.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 899 2024-09-14T21:42:55.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:56.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:42:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:42:56.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:42:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:42:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:56.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:42:56.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:42:57.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 901 2024-09-14T21:42:57.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 900 2024-09-14T21:42:57.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:57.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:42:57.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:42:57.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 903 2024-09-14T21:42:57.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:42:57.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:42:57.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:57.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:42:57.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:57.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:57.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:42:57.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:42:58.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 902 2024-09-14T21:42:58.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:42:58.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:42:58.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:42:58.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:42:58.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:42:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:42:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:42:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:42:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 905 2024-09-14T21:42:58.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:42:59.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 904 2024-09-14T21:42:59.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:00.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:00.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:00.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 906 2024-09-14T21:43:00.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 907 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:00.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:00.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:00.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:01.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 908 2024-09-14T21:43:01.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 909 2024-09-14T21:43:01.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:01.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:01.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:01.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:01.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:01.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:01.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:01.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:01.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 910 2024-09-14T21:43:01.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:01.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 911 2024-09-14T21:43:01.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:02.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 913 2024-09-14T21:43:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:02.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:03.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 912 2024-09-14T21:43:03.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:03.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 915 2024-09-14T21:43:03.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:03.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:03.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:03.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:03.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:03.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:03.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:03.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:03.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:04.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 914 2024-09-14T21:43:04.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:04.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:04.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:04.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 917 2024-09-14T21:43:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:43:04.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:04.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:04.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:43:04.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:43:04.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 916 2024-09-14T21:43:04.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:04.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:04.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:04.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:04.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:04.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:04.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:04.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:04.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:04.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:04.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:04.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:04.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:04.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:05.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:05.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:05.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 919 2024-09-14T21:43:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 918 2024-09-14T21:43:05.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:05.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:06.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:06.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:06.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:06.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:06.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:06.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:07.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 921 2024-09-14T21:43:07.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 920 2024-09-14T21:43:07.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:07.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 922 2024-09-14T21:43:07.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:07.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:07.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 923 2024-09-14T21:43:07.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:07.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:07.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:07.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:07.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:07.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:07.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:07.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:08.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 925 2024-09-14T21:43:08.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:08.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:43:08.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:43:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:43:08.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:08.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:09.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 924 2024-09-14T21:43:09.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:09.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 926 2024-09-14T21:43:09.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:10.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:10.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:10.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:10.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:10.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:10.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:10.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:10.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:10.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:10.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:10.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 927 2024-09-14T21:43:10.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 929 2024-09-14T21:43:10.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 928 2024-09-14T21:43:10.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:10.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:11.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 932 2024-09-14T21:43:11.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 930 2024-09-14T21:43:11.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:12.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:12.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:12.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:12.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:12.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:12.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:12.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:12.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:12.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:12.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:12.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:12.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 931 2024-09-14T21:43:13.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 933 2024-09-14T21:43:13.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:13.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:13.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 935 2024-09-14T21:43:13.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:13.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:13.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:43:13.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:13.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:13.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:43:13.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:13.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:14.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 934 2024-09-14T21:43:14.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:14.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 938 2024-09-14T21:43:14.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:14.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:14.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:14.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:15.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 936 2024-09-14T21:43:15.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 937 2024-09-14T21:43:16.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 939 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:16.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:16.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:16.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:16.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:16.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:17.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 941 2024-09-14T21:43:17.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 940 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:17.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:17.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:17.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 943 2024-09-14T21:43:17.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 942 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:17.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:17.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:17.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 945 2024-09-14T21:43:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:19.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 944 2024-09-14T21:43:19.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:43:19.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:43:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:19.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 947 2024-09-14T21:43:19.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:20.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 946 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:20.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:20.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 948 2024-09-14T21:43:20.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 949 2024-09-14T21:43:20.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:20.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:20.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:20.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:20.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:20.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:20.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:20.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:20.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:20.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:20.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:20.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:20.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:20.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:21.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 950 2024-09-14T21:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 951 2024-09-14T21:43:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:21.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:21.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:22.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:22.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:22.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:22.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:22.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:22.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:23.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 952 2024-09-14T21:43:23.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 953 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:23.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:23.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:23.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:23.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:43:23.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:43:23.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 955 2024-09-14T21:43:23.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:24.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 954 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:24.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:24.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:43:24.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:24.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:24.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:43:24.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:43:24.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 957 2024-09-14T21:43:24.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:25.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 956 2024-09-14T21:43:25.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 958 2024-09-14T21:43:26.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 959 2024-09-14T21:43:26.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:26.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:43:26.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:26.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:26.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:43:26.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:43:26.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:26.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:26.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:26.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:26.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:43:26.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:26.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:26.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:43:26.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:43:27.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 960 2024-09-14T21:43:27.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 961 2024-09-14T21:43:27.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:27.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 962 2024-09-14T21:43:27.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 963 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:27.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:27.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:27.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:43:27.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:43:28.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:28.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:28.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:28.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:28.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:28.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:28.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 965 2024-09-14T21:43:28.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:29.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 964 2024-09-14T21:43:29.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:29.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:43:29.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:29.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:29.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:43:29.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:43:29.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:29.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59391 2024-09-14T21:43:29.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 967 2024-09-14T21:43:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:30.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59523 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:43:30.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:43:30.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 966 2024-09-14T21:43:30.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:30.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59655 2024-09-14T21:43:30.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:30.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:43:30.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:30.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:30.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:43:30.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:43:30.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:30.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 968 2024-09-14T21:43:30.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:31.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 969 2024-09-14T21:43:31.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:43:31.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:43:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59807 2024-09-14T21:43:32.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:43:32.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:43:32.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:43:32.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:43:32.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:43:32.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:43:33.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 970 2024-09-14T21:43:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:33.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:33.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59960 2024-09-14T21:43:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60113 2024-09-14T21:43:34.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 971 2024-09-14T21:43:34.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:34.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:34.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60266 2024-09-14T21:43:35.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 972 2024-09-14T21:43:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:43:36.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:36.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60439 2024-09-14T21:43:37.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:43:37.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60613 2024-09-14T21:43:38.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:43:38.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:43:38.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59260 2024-09-14T21:46:04.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:04.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:04.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:04.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59392 2024-09-14T21:46:05.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:05.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:05.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:05.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59524 2024-09-14T21:46:06.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:06.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:06.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:06.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59656 2024-09-14T21:46:07.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:07.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:07.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:07.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59808 2024-09-14T21:46:08.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 59961 2024-09-14T21:46:09.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:09.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:09.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:09.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60114 2024-09-14T21:46:10.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:10.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:10.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:10.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60267 2024-09-14T21:46:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:11.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:11.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:11.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60440 2024-09-14T21:46:12.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:12.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:12.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:46:12.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 60614 2024-09-14T21:46:13.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:46:13.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:46:13.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:46:13.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T21:46:13.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T21:46:13.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T21:46:13.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T21:46:13.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T21:46:13.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T21:46:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T21:46:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:46:13.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:46:13.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T21:46:13.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:46:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T21:46:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T21:46:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T21:46:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66566 2024-09-14T21:46:14.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:46:14.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:46:14.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:46:14.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:46:14.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:46:14.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:46:14.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:46:14.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:46:14.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:46:14.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:46:14.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:47:08.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=f328f007e41c2c5bc0fad63222afc2fa 2024-09-14T21:47:08.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T21:47:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T21:47:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T21:47:08.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=10a4e63838cd2bfa3fd5227462766999 2024-09-14T21:47:08.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T21:47:09.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T21:47:09.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:09.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:09.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T21:47:09.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:09.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:09.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:09.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T21:47:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:09.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:09.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:09.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:09.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:10.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:10.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:10.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:10.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:10.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:10.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:10.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:10.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:10.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:10.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:47:10.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:10.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:10.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:10.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:47:10.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=2b438fba4ad6cfe4c5a49a1364a55290 2024-09-14T21:47:10.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T21:47:10.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:10.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:10.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:10.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:10.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:10.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:10.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:10.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:10.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:10.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T21:47:10.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:10.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T21:47:11.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=15633f092f9ec5350545d147063696e9 2024-09-14T21:47:11.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T21:47:11.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=6a49e2b1d92a3c4b86f558444b1bed6c 2024-09-14T21:47:11.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T21:47:11.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=40d4d6c9747220e1120795f6923632d9 2024-09-14T21:47:11.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T21:47:11.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T21:47:11.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:11.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T21:47:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T21:47:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T21:47:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T21:47:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T21:47:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=904027d79c9512b1e59a538ef75131fd 2024-09-14T21:47:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T21:47:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=cbad004983714fe6a2179cbfd3f833a2 2024-09-14T21:47:11.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T21:47:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=e2a99dfe84e99fc6586eb9685ec0f8d9 2024-09-14T21:47:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T21:47:11.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T21:47:11.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:11.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T21:47:11.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T21:47:11.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:11.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T21:47:11.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T21:47:11.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:11.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:11.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:11.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T21:47:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=9e8f34444f6deb77767bfe770d678b89 2024-09-14T21:47:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T21:47:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T21:47:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:12.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T21:47:12.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T21:47:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:12.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T21:47:12.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:12.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T21:47:12.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:12.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:12.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:12.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:47:12.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:12.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:12.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:12.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:12.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:13.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:13.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:13.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:47:13.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:13.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:13.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:47:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T21:47:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:13.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:47:13.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:13.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:47:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:13.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:47:13.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:13.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:13.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:13.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:13.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:13.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:13.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:13.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:13.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:13.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:47:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:14.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:47:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:15.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:15.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:15.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:15.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:15.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:15.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:15.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:16.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:16.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:16.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:16.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:16.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:16.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:16.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:16.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:16.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:16.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:16.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:47:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:17.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:17.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:17.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:47:17.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:17.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:17.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:17.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:17.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:17.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:17.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:17.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:17.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:17.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:17.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:17.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:17.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:17.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:17.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:17.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:17.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:17.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:19.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:19.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:19.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:47:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:47:19.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:19.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:19.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:19.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:19.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:19.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:19.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:19.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:19.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:20.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:20.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:20.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:20.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:20.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:47:20.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:20.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:47:20.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:20.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:20.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:20.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:20.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:25.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:25.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:25.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:25.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:25.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:25.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:25.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:25.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:25.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:25.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:25.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:25.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:25.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:25.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:25.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:27.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:27.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:27.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:27.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:27.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:27.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:27.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:27.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:47:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:47:28.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:28.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:28.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:28.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:28.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:28.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:47:28.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:47:28.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:28.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:01' 2024-09-14T21:47:28.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:28.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:33.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:33.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:33.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:33.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:47:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:33.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:33.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:33.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:33.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:33.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:33.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:33.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:33.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:33.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:33.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:33.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:33.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:33.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:33.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:33.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:33.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:33.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:33.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:33.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:33.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:33.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:33.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:33.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:33.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:33.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:33.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:33.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:33.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:33.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:33.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:33.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:47:33.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:33.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:33.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:47:33.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:33.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:33.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:47:33.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:47:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:33.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:33.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T21:47:34.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:34.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:34.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:34.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:34.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:34.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:34.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:34.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:34.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:34.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:34.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:34.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:34.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:34.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:34.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:34.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:34.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:34.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:34.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:34.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:34.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:34.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:34.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:34.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:34.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:47:34.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:34.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:34.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:47:34.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:34.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:47:34.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:34.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:47:34.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:34.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:34.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:47:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T21:47:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:34.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:34.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:34.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T21:47:35.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:35.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T21:47:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T21:47:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T21:47:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T21:47:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:47:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:47:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:47:36.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:36.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:47:36.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:36.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:36.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:47:36.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:36.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:36.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:36.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:36.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:36.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:36.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:36.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:36.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:36.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:36.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:36.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:36.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:36.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:36.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:47:36.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:47:36.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:47:36.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:47:36.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:36.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:36.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:47:36.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:36.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:47:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:47:36.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:47:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:36.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:47:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:47:36.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:47:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:36.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:47:36.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:36.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:36.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:36.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:36.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:36.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:47:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:36.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:47:37.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:37.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:37.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:37.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:37.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:47:37.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:47:37.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:47:37.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:47:37.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:37.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:37.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:37.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:37.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:47:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T21:47:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T21:47:37.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T21:47:37.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T21:47:37.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:47:37.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:47:37.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:47:37.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:47:37.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:37.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:37.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:37.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:37.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:37.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:37.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:47:37.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:37.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:37.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:37.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:47:37.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:37.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:47:37.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:37.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:37.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:47:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:37.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:37.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:37.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:37.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T21:47:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:47:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T21:47:38.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:47:38.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:47:38.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:47:38.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:47:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T21:47:38.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:47:38.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T21:47:38.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:47:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:47:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T21:47:38.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:47:38.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:47:38.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:47:38.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:47:38.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T21:47:38.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T21:47:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T21:47:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:47:38.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:38.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:38.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T21:47:38.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:38.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T21:47:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:47:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:47:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:38.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:38.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:38.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:38.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:38.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:38.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:38.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:38.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:38.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:47:31' 2024-09-14T21:47:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:47:38.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:47:38.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:47:38.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:47:38.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:47:38.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:47:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:47:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:47:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:47:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 21:47:31' 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:47:31' 2024-09-14T21:47:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:47:38.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:47:38.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:47:38.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:47:38.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:47:31' 2024-09-14T21:47:38.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:47:38.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:47:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:47:38.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:47:31' 2024-09-14T21:47:38.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:47:38.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:47:38.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:47:38.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:47:38.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:47:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T21:47:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:47:38.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T21:47:38.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T21:47:38.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T21:47:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T21:47:38.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T21:47:38.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T21:47:38.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T21:47:38.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:47:38.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:47:38.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T21:47:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T21:47:39.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:47:39.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T21:47:39.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:47:39.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T21:47:39.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:47:39.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T21:47:39.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:47:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T21:47:39.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:47:39.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T21:47:39.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T21:47:39.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:47:39.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:47:39.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:47:39.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T21:47:39.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:47:39.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:48:27.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=10a4e63838cd2bfa3fd5227462766999 2024-09-14T21:48:27.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T21:48:28.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 10a4e63838cd2bfa3fd5227462766999 != \1\0\a\4\e\6\3\8\3\8\c\d\2\b\f\a\3\f\d\5\2\2\7\4\6\2\7\6\6\9\9\9 ]] 2024-09-14T21:48:31.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=f328f007e41c2c5bc0fad63222afc2fa 2024-09-14T21:48:31.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T21:48:31.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ f328f007e41c2c5bc0fad63222afc2fa != \f\3\2\8\f\0\0\7\e\4\1\c\2\c\5\b\c\0\f\a\d\6\3\2\2\2\a\f\c\2\f\a ]] 2024-09-14T21:48:32.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=2b438fba4ad6cfe4c5a49a1364a55290 2024-09-14T21:48:32.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T21:48:32.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 2b438fba4ad6cfe4c5a49a1364a55290 != \2\b\4\3\8\f\b\a\4\a\d\6\c\f\e\4\c\5\a\4\9\a\1\3\6\4\a\5\5\2\9\0 ]] 2024-09-14T21:48:32.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=15633f092f9ec5350545d147063696e9 2024-09-14T21:48:32.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T21:48:33.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 15633f092f9ec5350545d147063696e9 != \1\5\6\3\3\f\0\9\2\f\9\e\c\5\3\5\0\5\4\5\d\1\4\7\0\6\3\6\9\6\e\9 ]] 2024-09-14T21:48:33.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=904027d79c9512b1e59a538ef75131fd 2024-09-14T21:48:33.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T21:48:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 904027d79c9512b1e59a538ef75131fd != \9\0\4\0\2\7\d\7\9\c\9\5\1\2\b\1\e\5\9\a\5\3\8\e\f\7\5\1\3\1\f\d ]] 2024-09-14T21:48:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66567 2024-09-14T21:48:33.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=40d4d6c9747220e1120795f6923632d9 2024-09-14T21:48:33.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T21:48:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=cbad004983714fe6a2179cbfd3f833a2 2024-09-14T21:48:34.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T21:48:34.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=e2a99dfe84e99fc6586eb9685ec0f8d9 2024-09-14T21:48:34.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T21:48:34.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 40d4d6c9747220e1120795f6923632d9 != \4\0\d\4\d\6\c\9\7\4\7\2\2\0\e\1\1\2\0\7\9\5\f\6\9\2\3\6\3\2\d\9 ]] 2024-09-14T21:48:34.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ cbad004983714fe6a2179cbfd3f833a2 != \c\b\a\d\0\0\4\9\8\3\7\1\4\f\e\6\a\2\1\7\9\c\b\f\d\3\f\8\3\3\a\2 ]] 2024-09-14T21:48:34.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ e2a99dfe84e99fc6586eb9685ec0f8d9 != \e\2\a\9\9\d\f\e\8\4\e\9\9\f\c\6\5\8\6\e\b\9\6\8\5\e\c\0\f\8\d\9 ]] 2024-09-14T21:48:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=6a49e2b1d92a3c4b86f558444b1bed6c 2024-09-14T21:48:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T21:48:34.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 6a49e2b1d92a3c4b86f558444b1bed6c != \6\a\4\9\e\2\b\1\d\9\2\a\3\c\4\b\8\6\f\5\5\8\4\4\4\b\1\b\e\d\6\c ]] 2024-09-14T21:48:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66568 2024-09-14T21:48:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66571 2024-09-14T21:48:34.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=9e8f34444f6deb77767bfe770d678b89 2024-09-14T21:48:34.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T21:48:34.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 9e8f34444f6deb77767bfe770d678b89 != \9\e\8\f\3\4\4\4\4\f\6\d\e\b\7\7\7\6\7\b\f\e\7\7\0\d\6\7\8\b\8\9 ]] 2024-09-14T21:48:34.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66573 2024-09-14T21:48:34.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66575 2024-09-14T21:48:34.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66577 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66579 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66581 2024-09-14T21:48:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:48:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 66583 2024-09-14T21:48:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:48:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:48:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T21:48:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:34.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: dcffa82f-9117-48e1-a28f-9050ab56a4a0 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3165593.6,"bytes_per_snapshot":63311872.0,"last_snapshot_bytes":63311872,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:36.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:36.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:36.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:36.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3165593.6,"bytes_per_snapshot":63311872.0,"last_snapshot_bytes":63311872,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:36.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:36.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:36.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:36.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:36.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:36.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:36.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:36.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:36.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:36.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:36.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:36.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1dcffa82f-9117-48e1-a28f-9050ab56a4a0up+replayingreplaying, {"bytes_per_second":3165593.6,"bytes_per_snapshot":63311872.0,"last_snapshot_bytes":63311872,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+replayingreplaying, {"bytes_per_second":3228876.8,"bytes_per_snapshot":64577536.0,"last_snapshot_bytes":64577536,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+replayingreplaying, {"bytes_per_second":3163136.0,"bytes_per_snapshot":63262720.0,"last_snapshot_bytes":63262720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+replayingreplaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+replayingreplaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:36.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:36.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:48:36.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:36.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:48:36.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:36.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:36.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T21:48:36.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T21:48:36.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:36.381+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7669c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:36.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:36.381+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcac80 [3/dcffa82f-9117-48e1-a28f-9050ab56a4a0] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T21:48:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T21:48:37.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:37.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:37.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:38.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:38.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:48:38.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:48:38.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e1904352-ade9-4a94-bd4c-1306463a9672 2024-09-14T21:48:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3228876.8,"bytes_per_snapshot":64577536.0,"last_snapshot_bytes":64577536,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:38.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:38.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:38.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3228876.8,"bytes_per_snapshot":64577536.0,"last_snapshot_bytes":64577536,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:38.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:38.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:38.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:38.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:38.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:38.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary2e1904352-ade9-4a94-bd4c-1306463a9672up+replayingreplaying, {"bytes_per_second":3228876.8,"bytes_per_snapshot":64577536.0,"last_snapshot_bytes":64577536,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+replayingreplaying, {"bytes_per_second":3163136.0,"bytes_per_snapshot":63262720.0,"last_snapshot_bytes":63262720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+replayingreplaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+replayingreplaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:38.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:38.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:48:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:38.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:48:38.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:38.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:38.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:38.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:38.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:38.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T21:48:38.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T21:48:39.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:39.043+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588dcd6c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:39.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:39.043+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/e1904352-ade9-4a94-bd4c-1306463a9672] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:40.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:40.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T21:48:40.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:40.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:40.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:48:40.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:40.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:40.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T21:48:40.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:40.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T21:48:40.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:40.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:41.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:41.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:41.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:48:41.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:48:41.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 626d5f79-5020-4de9-bc18-f20df2c2ffd0 2024-09-14T21:48:41.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3163136.0,"bytes_per_snapshot":63262720.0,"last_snapshot_bytes":63262720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:41.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:41.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:41.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3163136.0,"bytes_per_snapshot":63262720.0,"last_snapshot_bytes":63262720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:41.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:41.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:41.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:41.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:41.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:41.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:41.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:41.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:41.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:41.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:41.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:41.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:41.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:41.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary3626d5f79-5020-4de9-bc18-f20df2c2ffd0up+replayingreplaying, {"bytes_per_second":3163136.0,"bytes_per_snapshot":63262720.0,"last_snapshot_bytes":63262720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+replayingreplaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+replayingreplaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:41.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:41.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:48:41.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:41.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:48:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:41.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:41.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T21:48:41.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:41.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:41.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:41.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T21:48:41.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T21:48:42.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:42.048+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a767520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:42.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:42.048+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaf00 [3/626d5f79-5020-4de9-bc18-f20df2c2ffd0] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:42.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:42.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T21:48:42.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:42.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:42.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:48:42.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:42.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:42.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T21:48:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T21:48:42.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:42.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:42.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:43.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:43.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 370a05c3-1213-4e45-9b1c-14761e4bb918 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:43.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:43.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:43.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:43.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:43.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:43.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:43.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:43.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:43.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:43.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:43.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:43.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:43.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:43.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary4370a05c3-1213-4e45-9b1c-14761e4bb918up+replayingreplaying, {"bytes_per_second":3326361.6,"bytes_per_snapshot":66527232.0,"last_snapshot_bytes":66527232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+replayingreplaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:43.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:43.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:48:43.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:43.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:48:43.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:43.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:43.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:43.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:43.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:43.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:43.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T21:48:43.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:43.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T21:48:44.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T21:48:44.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:44.251+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5890f7860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:44.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:44.251+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/370a05c3-1213-4e45-9b1c-14761e4bb918] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:45.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:45.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T21:48:45.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:45.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T21:48:45.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:45.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:46.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:46.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:46.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 157ef821-a848-4fc2-a611-c3fc783ce46d 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:46.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:46.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:46.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:46.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:46.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:46.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:46.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:46.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:46.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:46.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:46.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:46.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:46.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:46.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:46.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:46.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary5157ef821-a848-4fc2-a611-c3fc783ce46dup+replayingreplaying, {"bytes_per_second":3158016.0,"bytes_per_snapshot":63160320.0,"last_snapshot_bytes":63160320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:46.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:46.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:48:46.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:46.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:48:46.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:46.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:46.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:46.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:46.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T21:48:47.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T21:48:47.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:47.163+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588dcc340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:47.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:47.163+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/157ef821-a848-4fc2-a611-c3fc783ce46d] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:48.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:48.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T21:48:48.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:48.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:48.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:48:48.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:48.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:48.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T21:48:48.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:48.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:48.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:48.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:49.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:49.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:49.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:48:49.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:48:49.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 24e2efbd-8390-4d76-9667-327ac3035d08 2024-09-14T21:48:49.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:49.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:49.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:49.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:49.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:49.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:49.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:49.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:49.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:49.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:49.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:49.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:49.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:49.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:49.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:49.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:49.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:49.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:49.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:49.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:49.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:49.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:49.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:49.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:49.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:49.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary624e2efbd-8390-4d76-9667-327ac3035d08up+replayingreplaying, {"bytes_per_second":3352576.0,"bytes_per_snapshot":67051520.0,"last_snapshot_bytes":67051520,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:49.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:49.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:48:49.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:49.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:48:49.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:49.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:49.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:49.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:49.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T21:48:50.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T21:48:50.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:50.176+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589cc3520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:50.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:50.176+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/24e2efbd-8390-4d76-9667-327ac3035d08] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:51.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:51.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T21:48:51.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:51.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:51.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:48:51.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:51.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:51.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T21:48:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:51.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:51.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:51.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:51.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:51.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:52.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:52.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 6813748c-9338-4964-83ff-df8e2871172a 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:52.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:52.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:52.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:52.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:52.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:52.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:52.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:52.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:52.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:52.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:53.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary76813748c-9338-4964-83ff-df8e2871172aup+replayingreplaying, {"bytes_per_second":3348889.6,"bytes_per_snapshot":66977792.0,"last_snapshot_bytes":66977792,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:53.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:53.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:48:53.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:53.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:48:53.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:53.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:53.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:53.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:53.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:53.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:53.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T21:48:53.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:53.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:53.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:53.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T21:48:53.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T21:48:53.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:53.213+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58bc0b860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:53.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:53.213+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/6813748c-9338-4964-83ff-df8e2871172a] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:54.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:54.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:54.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T21:48:54.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:54.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:54.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:54.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:54.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:54.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:54.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:55.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 95403f40-a0fe-4829-9a41-05e78cef9b8e 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:55.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:55.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:55.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:55.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"} 2024-09-14T21:48:55.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:55.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:55.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:55.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:55.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:55.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:55.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:55.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:55.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:55.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:55.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary895403f40-a0fe-4829-9a41-05e78cef9b8eup+replayingreplaying, {"bytes_per_second":3184844.8,"bytes_per_snapshot":63696896.0,"last_snapshot_bytes":63696896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350458,"remote_snapshot_timestamp":1726350458,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:55.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:55.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:48:55.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:55.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:48:55.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:55.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:55.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:55.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:55.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:55.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T21:48:56.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T21:48:56.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:56.164+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80fba0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:56.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:56.165+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/95403f40-a0fe-4829-9a41-05e78cef9b8e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:48:57.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:48:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T21:48:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:48:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:57.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:48:57.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T21:48:57.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:57.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:57.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:48:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:48:57.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:48:58.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T21:48:58.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:58.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:58.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:48:58.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:48:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:48:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:58.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b1017178-1722-423b-b0d5-5b2fee953a6a 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"} 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:48:31' 2024-09-14T21:48:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:48:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:48:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:48:58.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"} 2024-09-14T21:48:58.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:48:58.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:58.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:48:58.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:58.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:48:58.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:48:58.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:48:58.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 21:48:31' 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:48:31' 2024-09-14T21:48:58.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:48:58.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:48:58.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:48:58.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":3667148.8,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31image-primary9b1017178-1722-423b-b0d5-5b2fee953a6aup+replayingreplaying, {"bytes_per_second":3232972.8,"bytes_per_snapshot":64659456.0,"last_snapshot_bytes":64659456,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:48:31' 2024-09-14T21:48:58.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:48:58.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:48:58.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:48:31' 2024-09-14T21:48:58.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:48:58.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:48:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:48:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:48:58.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:48:58.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:48:58.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T21:48:59.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T21:48:59.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:59.151+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80f860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:48:59.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:48:59.151+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/b1017178-1722-423b-b0d5-5b2fee953a6a] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:49:00.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:49:01.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T21:49:01.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:49:01.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:49:02.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:49:02.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:49:02.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:49:02.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 89d3acc4-5130-49dd-93cc-a419ef6e7fbd 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"} 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:49:01' 2024-09-14T21:49:02.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:49:02.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:49:02.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:49:02.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"} 2024-09-14T21:49:02.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:49:02.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:49:02.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:49:02.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:49:02.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:49:02.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:49:02.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:49:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:49:01' 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 21:49:01' 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:02.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:49:02.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:49:01' 2024-09-14T21:49:02.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:49:02.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:49:02.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:49:02.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1089d3acc4-5130-49dd-93cc-a419ef6e7fbdup+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":73342976.0,"last_snapshot_bytes":73342976,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350455,"remote_snapshot_timestamp":1726350455,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:49:01' 2024-09-14T21:49:02.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:49:02.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:49:02.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:49:01' 2024-09-14T21:49:02.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:49:02.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:49:02.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:49:02.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:49:02.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:49:02.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:02.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:02.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T21:49:02.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:49:02.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:02.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:02.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T21:49:02.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T21:49:02.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:49:02.457+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588c656c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:49:02.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:49:02.457+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb680 [3/89d3acc4-5130-49dd-93cc-a419ef6e7fbd] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:49:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:49:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T21:49:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:49:03.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:49:03.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T21:49:03.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:03.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T21:49:03.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T21:49:03.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T21:49:03.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T21:49:03.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T21:49:03.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:03.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:03.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T21:49:03.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:03.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:03.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:03.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T21:49:04.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:04.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T21:49:04.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f3549aed969 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f3549aed969 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:03 2024 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:03 2024 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:03 2024 2024-09-14T21:49:04.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:49:04.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:04.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:04.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:04.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T21:49:04.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T21:49:04.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:04.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T21:49:04.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 536ea7d9-b4f7-49f9-83ec-815f2c442d33 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:04.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:04.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:04.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:04.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:04.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T21:49:04.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T21:49:04.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:04.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:04.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T21:49:04.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:04.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T21:49:04.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:04.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T21:49:05.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:05.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T21:49:05.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:05.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 994 2024-09-14T21:49:05.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:05.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T21:49:05.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T21:49:05.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f45f6004abe 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f45f6004abe 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:04 2024 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:04 2024 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:04 2024 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:49:05.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:05.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:05.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:05.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T21:49:05.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T21:49:05.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:05.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T21:49:05.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:05.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:05.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:05.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b53768a9-25b4-45f8-968a-921c1cd9431e 2024-09-14T21:49:05.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:05.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:05.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:05.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:05.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:05.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:05.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:05.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:05.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T21:49:05.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T21:49:05.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:05.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T21:49:05.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:05.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T21:49:05.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:05.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:05.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:05.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:05.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:05.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:49:05.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T21:49:05.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T21:49:05.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T21:49:05.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T21:49:05.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:05.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:05.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:05.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:05.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T21:49:06.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:06.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T21:49:06.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:06.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 996 2024-09-14T21:49:06.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:06.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T21:49:06.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f54a2fbbc91 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f54a2fbbc91 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:05 2024 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:05 2024 2024-09-14T21:49:06.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:05 2024 2024-09-14T21:49:06.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:06.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:06.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:49:06.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:06.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:06.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:06.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T21:49:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T21:49:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:06.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T21:49:06.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:06.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:06.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:06.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: a2d685a3-777a-4d25-afa4-a97ae68b2e05 2024-09-14T21:49:06.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:06.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:06.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:06.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:06.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:06.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:06.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:06.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:06.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T21:49:06.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T21:49:06.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:06.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T21:49:06.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:06.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T21:49:06.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T21:49:06.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:06.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:06.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:06.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T21:49:06.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T21:49:06.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T21:49:06.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:06.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T21:49:07.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:07.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T21:49:07.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:07.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 998 2024-09-14T21:49:07.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T21:49:07.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f62b2d462a2 2024-09-14T21:49:07.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f62b2d462a2 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:06 2024 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:06 2024 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:06 2024 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:49:07.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:07.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:07.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:07.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T21:49:07.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T21:49:07.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:07.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T21:49:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: d6c70824-4f36-4d33-8a46-4941310466ac 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:07.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:07.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:07.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T21:49:07.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T21:49:07.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:07.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T21:49:07.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:07.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:07.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:07.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:07.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:08.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:08.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:08.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T21:49:08.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:08.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:08.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:08.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:08.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1000 2024-09-14T21:49:08.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T21:49:08.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f71848657af 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f71848657af 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:08.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:08 2024 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:08 2024 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:08 2024 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:49:08.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:08.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:08.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:08.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T21:49:08.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T21:49:08.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:08.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T21:49:08.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 0fa15717-99ae-4ed4-9d4e-97ead1cdaa60 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:08.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:08.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:08.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:08.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:08.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T21:49:08.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T21:49:08.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:08.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T21:49:09.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T21:49:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T21:49:09.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:09.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:09.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T21:49:09.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:09.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T21:49:09.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1002 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:09.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:09.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:09.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1003 2024-09-14T21:49:09.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:09.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:09.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f801cf1e0c 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f801cf1e0c 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:09.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:09.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:09.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:09.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:09.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:49:09.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:09.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:09.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:09.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T21:49:09.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T21:49:09.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:09.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T21:49:09.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:09.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 1e8f3943-90d6-4a70-a655-9e0e71d3ded3 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:09.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:09.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:09.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:09.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:09.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T21:49:09.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T21:49:09.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:09.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:09.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:09.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:09.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T21:49:09.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:09.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:09.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:09.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T21:49:09.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:09.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:09.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:09.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:09.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T21:49:10.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:10.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T21:49:10.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1005 2024-09-14T21:49:10.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:10.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1006 2024-09-14T21:49:10.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T21:49:10.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:10.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:10.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:10.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:10.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:10.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:10.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1f9123c950 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1f9123c950 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:10.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:10.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:09 2024 2024-09-14T21:49:10.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:10.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:10.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:49:10.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:10.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:10.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:10.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T21:49:10.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T21:49:10.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:10.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T21:49:10.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 273a40c1-df91-43d4-979d-a88f7bc298cf 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:10.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:10.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:10.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:10.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:10.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T21:49:10.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T21:49:10.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:10.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:10.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:10.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T21:49:10.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T21:49:10.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:10.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T21:49:11.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:11.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T21:49:11.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:11.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1009 2024-09-14T21:49:11.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1008 2024-09-14T21:49:11.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:11.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T21:49:11.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1fa3eda3a5fb 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1fa3eda3a5fb 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:11.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:10 2024 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:10 2024 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:10 2024 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:49:11.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:11.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:11.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:11.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T21:49:11.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T21:49:11.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:11.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T21:49:11.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 513ec372-61e3-4050-99c1-2d1bdd186a27 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:11.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:11.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:11.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:11.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:11.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T21:49:11.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T21:49:11.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:11.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T21:49:11.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:11.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:11.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:12.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:12.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T21:49:12.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:12.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T21:49:12.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:12.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1011 2024-09-14T21:49:12.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1012 2024-09-14T21:49:12.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T21:49:12.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:12.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:12.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:12.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T21:49:12.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:12.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1fb482174407 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1fb482174407 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:11 2024 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:11 2024 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:11 2024 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:49:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:12.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:12.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:12.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T21:49:12.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T21:49:12.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:12.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T21:49:12.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:12.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 258da7b0-059c-4cd9-9e7c-0d603efb8b25 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:12.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:12.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:12.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T21:49:12.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T21:49:12.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:12.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T21:49:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T21:49:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:49:12.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T21:49:12.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:49:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:49:12.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T21:49:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T21:49:13.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:13.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:13.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:13.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:13.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:13.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:13.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:13.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:49:13.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1015 2024-09-14T21:49:13.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1016 2024-09-14T21:49:13.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1014 2024-09-14T21:49:13.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:13.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T21:49:13.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:13.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 1fc91d1aba93 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.1fc91d1aba93 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:49:13.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:49:12 2024 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:49:12 2024 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:49:12 2024 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:49:13.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:49:13.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:49:13.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:49:13.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T21:49:13.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T21:49:13.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:49:13.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T21:49:13.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:49:13.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: f3d4fdc0-3575-437a-aaff-f8c0d48c1b1a 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:49:13.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:49:13.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:49:13.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:49:13.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:49:13.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T21:49:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T21:49:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:49:13.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T21:49:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:49:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T21:49:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71224 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T21:49:13.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T21:49:14.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:49:14.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:14.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1019 2024-09-14T21:49:14.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:14.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1018 2024-09-14T21:49:14.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1020 2024-09-14T21:49:14.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:14.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:15.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:15.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:15.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:15.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:15.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:15.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:15.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1022 2024-09-14T21:49:15.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:15.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1021 2024-09-14T21:49:15.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:16.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:16.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:16.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:16.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:16.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:16.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:16.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:16.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1024 2024-09-14T21:49:16.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1023 2024-09-14T21:49:16.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:16.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:17.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:17.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:17.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:17.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1026 2024-09-14T21:49:17.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1027 2024-09-14T21:49:17.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1025 2024-09-14T21:49:17.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:17.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:17.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:18.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1030 2024-09-14T21:49:18.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1028 2024-09-14T21:49:18.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1029 2024-09-14T21:49:18.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:18.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:18.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:18.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:19.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:19.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:19.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:19.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:19.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:19.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:19.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1032 2024-09-14T21:49:19.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1031 2024-09-14T21:49:19.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:19.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:20.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1034 2024-09-14T21:49:20.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1033 2024-09-14T21:49:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:20.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:20.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:20.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:20.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:21.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:21.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:21.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:21.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1036 2024-09-14T21:49:21.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1035 2024-09-14T21:49:21.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1037 2024-09-14T21:49:21.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:21.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:21.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:22.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1040 2024-09-14T21:49:22.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1038 2024-09-14T21:49:22.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1039 2024-09-14T21:49:22.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:22.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:22.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:22.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:22.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:22.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:22.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:22.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:22.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:23.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1041 2024-09-14T21:49:23.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1042 2024-09-14T21:49:23.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:23.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:23.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:24.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1044 2024-09-14T21:49:24.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1043 2024-09-14T21:49:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:24.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:24.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:24.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:24.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:24.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:24.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:24.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:24.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:25.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:25.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:25.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:25.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:25.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:25.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:25.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:25.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:25.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:25.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:25.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1046 2024-09-14T21:49:25.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1045 2024-09-14T21:49:25.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:26.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1048 2024-09-14T21:49:26.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:26.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1050 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:26.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:26.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:27.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1047 2024-09-14T21:49:27.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:27.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1051 2024-09-14T21:49:27.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:27.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:27.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:27.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:27.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:27.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:27.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:27.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:27.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:27.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:27.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:27.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:27.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:28.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1049 2024-09-14T21:49:28.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:28.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1054 2024-09-14T21:49:28.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:28.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:28.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:29.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1052 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:29.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:29.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:29.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1055 2024-09-14T21:49:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:30.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1053 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:30.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:30.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:30.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:30.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1057 2024-09-14T21:49:30.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:31.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:31.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1056 2024-09-14T21:49:31.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:31.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:31.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1059 2024-09-14T21:49:31.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:32.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1058 2024-09-14T21:49:32.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:32.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1061 2024-09-14T21:49:32.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:32.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:33.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1060 2024-09-14T21:49:33.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:33.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:33.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:33.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:33.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:33.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:33.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:33.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1063 2024-09-14T21:49:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:33.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:33.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:34.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1062 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:34.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:34.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:34.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:34.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1065 2024-09-14T21:49:34.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:35.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:35.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1064 2024-09-14T21:49:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:35.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:35.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:35.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:35.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1067 2024-09-14T21:49:35.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1066 2024-09-14T21:49:36.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:36.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:36.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:36.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:36.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:36.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:36.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:36.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:36.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1069 2024-09-14T21:49:36.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:37.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1068 2024-09-14T21:49:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1071 2024-09-14T21:49:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:37.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:38.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1070 2024-09-14T21:49:38.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:38.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:38.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:38.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:38.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:38.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:38.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:38.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1073 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:39.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1072 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:39.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1075 2024-09-14T21:49:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:39.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:40.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:40.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:40.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:40.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:40.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:40.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:40.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1074 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:40.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:40.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:40.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1076 2024-09-14T21:49:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1077 2024-09-14T21:49:40.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:40.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:41.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:41.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1078 2024-09-14T21:49:41.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:41.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1079 2024-09-14T21:49:41.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:41.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:41.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:41.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:41.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:41.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:41.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:42.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1080 2024-09-14T21:49:42.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1081 2024-09-14T21:49:42.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:42.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:42.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:42.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:42.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:42.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:42.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:42.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:42.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:43.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:43.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:43.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:43.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:43.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:43.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:43.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1083 2024-09-14T21:49:43.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:43.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:43.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:43.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:43.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:43.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:43.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:44.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1082 2024-09-14T21:49:44.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:44.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1084 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:44.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:44.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:44.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1085 2024-09-14T21:49:44.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:44.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:44.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:44.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:44.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:44.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:44.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:45.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:45.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1086 2024-09-14T21:49:45.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1087 2024-09-14T21:49:45.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:45.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:46.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1088 2024-09-14T21:49:46.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1089 2024-09-14T21:49:46.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:46.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:46.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:46.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:47.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1091 2024-09-14T21:49:47.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:47.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1090 2024-09-14T21:49:47.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:47.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:47.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:47.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:47.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:47.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:47.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:47.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:47.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:47.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:47.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:47.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:47.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:47.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:47.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:47.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:47.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:47.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:47.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:48.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1093 2024-09-14T21:49:48.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:48.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:48.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:48.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:49.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1092 2024-09-14T21:49:49.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:49.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:49.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:49.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:49.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:49.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:49.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:49.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:50.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1095 2024-09-14T21:49:50.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1094 2024-09-14T21:49:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:50.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:50.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:50.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:51.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1096 2024-09-14T21:49:51.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1097 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:51.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:51.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:51.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:52.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1099 2024-09-14T21:49:52.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1098 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:52.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:52.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:52.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:53.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1100 2024-09-14T21:49:53.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1101 2024-09-14T21:49:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:53.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:53.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:53.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:53.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:53.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1103 2024-09-14T21:49:53.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:54.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1102 2024-09-14T21:49:54.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:54.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1105 2024-09-14T21:49:54.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1104 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:54.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:54.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:54.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:55.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:55.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:55.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:55.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:55.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:55.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:55.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:49:55.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1106 2024-09-14T21:49:55.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1107 2024-09-14T21:49:55.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:55.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:56.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:49:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:49:56.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:49:56.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:56.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:49:56.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:56.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:56.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:49:56.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:49:56.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1108 2024-09-14T21:49:56.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1109 2024-09-14T21:49:56.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:56.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:49:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:49:57.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1111 2024-09-14T21:49:57.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1110 2024-09-14T21:49:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:49:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:57.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:49:57.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:49:57.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:57.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:57.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:57.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:49:57.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:57.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:57.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:49:57.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:49:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:49:58.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:58.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:49:58.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:58.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:58.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:49:58.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:49:58.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:49:58.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1113 2024-09-14T21:49:58.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:59.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1112 2024-09-14T21:49:59.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:49:59.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:49:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:49:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:49:59.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:00.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1114 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:00.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:00.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:00.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:00.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:00.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:00.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:00.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:00.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1115 2024-09-14T21:50:00.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:00.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:01.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1116 2024-09-14T21:50:01.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1117 2024-09-14T21:50:01.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:01.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:01.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:02.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1118 2024-09-14T21:50:02.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1119 2024-09-14T21:50:02.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:02.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:02.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:03.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1121 2024-09-14T21:50:03.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1120 2024-09-14T21:50:03.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:03.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:03.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:03.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:03.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:03.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:03.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:03.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:03.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1123 2024-09-14T21:50:03.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:03.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:03.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:03.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:03.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:03.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:03.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:04.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1122 2024-09-14T21:50:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:04.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1125 2024-09-14T21:50:04.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:04.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:04.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:04.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:04.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:04.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:04.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1124 2024-09-14T21:50:04.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:04.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:04.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:04.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:04.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:04.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:04.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:04.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:05.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:05.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1126 2024-09-14T21:50:05.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1127 2024-09-14T21:50:05.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:05.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:06.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:06.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:06.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:06.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:06.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:06.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:06.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:06.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1128 2024-09-14T21:50:06.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1129 2024-09-14T21:50:06.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:06.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:07.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1132 2024-09-14T21:50:07.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:07.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1130 2024-09-14T21:50:07.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:07.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:07.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:07.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:07.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:07.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:07.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:07.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:07.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:07.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:07.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:07.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:07.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:07.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:08.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1133 2024-09-14T21:50:08.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:08.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:08.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:08.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:08.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:08.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:08.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:08.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1131 2024-09-14T21:50:09.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:09.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:09.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:09.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:09.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:09.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:09.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:09.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:10.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:10.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:10.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1134 2024-09-14T21:50:10.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1135 2024-09-14T21:50:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:10.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:11.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1136 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:11.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:11.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1137 2024-09-14T21:50:11.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:11.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1138 2024-09-14T21:50:12.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1139 2024-09-14T21:50:12.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:12.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:12.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:12.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:12.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:12.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:12.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:12.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1141 2024-09-14T21:50:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1140 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:13.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:13.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:13.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:13.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:13.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1143 2024-09-14T21:50:13.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1142 2024-09-14T21:50:14.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:14.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1145 2024-09-14T21:50:14.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1144 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:14.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:14.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:14.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:15.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:15.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:15.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:15.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:15.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:15.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:15.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1147 2024-09-14T21:50:15.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1146 2024-09-14T21:50:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:16.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1149 2024-09-14T21:50:16.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1148 2024-09-14T21:50:16.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:16.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:16.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:16.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:16.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:16.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:16.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:16.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:16.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:16.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1150 2024-09-14T21:50:17.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1151 2024-09-14T21:50:17.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:17.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:17.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:17.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:17.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:17.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:17.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:17.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:17.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:17.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:17.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:17.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:17.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:17.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:17.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:17.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:17.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:17.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:17.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:17.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:18.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1153 2024-09-14T21:50:18.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:18.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:18.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:18.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:18.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:19.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1152 2024-09-14T21:50:19.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:19.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:19.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:19.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:19.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:19.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:19.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:19.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:20.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1154 2024-09-14T21:50:20.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1155 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:20.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:20.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:21.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1156 2024-09-14T21:50:21.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1157 2024-09-14T21:50:21.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:21.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:21.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:21.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:21.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:21.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:21.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:21.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:22.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1158 2024-09-14T21:50:22.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1159 2024-09-14T21:50:22.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:22.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:22.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:23.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1160 2024-09-14T21:50:23.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1161 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:23.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:23.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:23.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:23.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:23.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:23.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:23.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:23.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:23.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:23.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1163 2024-09-14T21:50:23.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:24.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1162 2024-09-14T21:50:24.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:24.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1165 2024-09-14T21:50:24.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1164 2024-09-14T21:50:24.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:24.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:24.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:24.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:24.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:24.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:24.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:24.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1167 2024-09-14T21:50:25.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1166 2024-09-14T21:50:25.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:25.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:25.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:26.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1169 2024-09-14T21:50:26.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1168 2024-09-14T21:50:26.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:26.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:26.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:26.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:26.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:26.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:26.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:26.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:26.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:26.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:27.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1171 2024-09-14T21:50:27.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1170 2024-09-14T21:50:27.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:27.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:27.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:27.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:27.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:27.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:27.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:27.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:27.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:27.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:27.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:27.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:27.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:27.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:27.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:28.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:28.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:28.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:28.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:28.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:28.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:28.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:28.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1173 2024-09-14T21:50:28.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:29.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:29.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1172 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:29.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:29.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:30.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:30.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:30.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:30.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:30.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:30.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:30.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:30.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1175 2024-09-14T21:50:30.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1174 2024-09-14T21:50:30.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:30.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:31.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1177 2024-09-14T21:50:31.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1176 2024-09-14T21:50:31.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:31.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:31.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:31.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:31.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:31.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:31.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:31.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:32.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1179 2024-09-14T21:50:32.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1178 2024-09-14T21:50:32.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:32.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:32.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:32.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:32.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:32.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:32.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:32.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:33.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1180 2024-09-14T21:50:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1181 2024-09-14T21:50:33.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:33.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:33.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:33.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:33.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:33.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:33.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:33.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1183 2024-09-14T21:50:33.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:34.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1182 2024-09-14T21:50:34.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:34.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1184 2024-09-14T21:50:34.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1185 2024-09-14T21:50:34.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:34.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:35.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:35.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:35.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:35.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:35.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:35.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:35.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1187 2024-09-14T21:50:35.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1186 2024-09-14T21:50:35.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:36.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1189 2024-09-14T21:50:36.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1188 2024-09-14T21:50:36.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:36.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:36.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:36.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:36.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:36.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1191 2024-09-14T21:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1190 2024-09-14T21:50:37.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:37.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:37.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:37.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:37.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:37.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1193 2024-09-14T21:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:38.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:38.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:38.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:39.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1192 2024-09-14T21:50:39.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:39.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:39.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:39.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:39.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:39.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:39.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:39.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:40.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1194 2024-09-14T21:50:40.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1195 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:40.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:40.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:40.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:41.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1196 2024-09-14T21:50:41.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1197 2024-09-14T21:50:41.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:41.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:41.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:41.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:41.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:41.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:41.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:41.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:42.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1198 2024-09-14T21:50:42.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1199 2024-09-14T21:50:42.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:42.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:43.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1200 2024-09-14T21:50:43.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1201 2024-09-14T21:50:43.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:43.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:43.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:43.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1203 2024-09-14T21:50:43.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:44.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1202 2024-09-14T21:50:44.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:44.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1205 2024-09-14T21:50:44.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1204 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:44.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:44.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:44.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:44.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:44.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:44.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:44.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:44.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:45.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1206 2024-09-14T21:50:45.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1207 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:45.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:45.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:45.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:45.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:46.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1209 2024-09-14T21:50:46.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1208 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:46.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:46.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:46.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:46.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:46.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:46.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:46.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:46.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:46.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:46.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:46.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:47.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1210 2024-09-14T21:50:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1211 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:47.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:47.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:47.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:47.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:48.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:48.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:48.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:48.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:48.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:48.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:48.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1213 2024-09-14T21:50:48.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:49.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1212 2024-09-14T21:50:49.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:49.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:49.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:49.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:49.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:49.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:49.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:49.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1215 2024-09-14T21:50:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1214 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:50.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:50.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:50.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:50.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:51.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1217 2024-09-14T21:50:51.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1216 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:51.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:52.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1218 2024-09-14T21:50:52.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1219 2024-09-14T21:50:52.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:52.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:52.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1221 2024-09-14T21:50:52.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1220 2024-09-14T21:50:52.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:52.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:52.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:52.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:52.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:52.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:52.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:52.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:53.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1222 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:53.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:53.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1223 2024-09-14T21:50:53.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:53.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:54.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1225 2024-09-14T21:50:54.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1224 2024-09-14T21:50:54.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:54.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:54.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:55.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1227 2024-09-14T21:50:55.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1226 2024-09-14T21:50:55.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:50:55.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:50:55.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:50:55.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:50:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:50:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:50:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:50:56.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1229 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:50:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:50:56.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1228 2024-09-14T21:50:56.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:56.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:50:57.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:50:57.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:50:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:50:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:58.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:50:58.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:50:58.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:50:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:50:58.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:50:58.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1231 2024-09-14T21:50:58.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1230 2024-09-14T21:50:58.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:58.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:59.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1233 2024-09-14T21:50:59.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1232 2024-09-14T21:50:59.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:59.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:50:59.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:59.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:59.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:50:59.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:50:59.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:50:59.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:50:59.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:00.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1235 2024-09-14T21:51:00.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1234 2024-09-14T21:51:00.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:00.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:01.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1237 2024-09-14T21:51:01.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1236 2024-09-14T21:51:01.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:01.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:01.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:01.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:01.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:01.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:01.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:01.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:01.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:01.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1238 2024-09-14T21:51:01.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:02.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1239 2024-09-14T21:51:02.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:02.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1241 2024-09-14T21:51:02.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1240 2024-09-14T21:51:02.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:02.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:02.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:02.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:02.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:02.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:02.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:03.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1242 2024-09-14T21:51:03.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1243 2024-09-14T21:51:03.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:03.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:03.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:03.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:03.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:03.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:03.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:03.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:03.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1244 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:04.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1245 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:04.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:04.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:04.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:05.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:05.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:51:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:51:05.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:05.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:05.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:05.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1246 2024-09-14T21:51:05.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1247 2024-09-14T21:51:05.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:05.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:06.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:06.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:06.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:06.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:06.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:06.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:06.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:06.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1249 2024-09-14T21:51:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:07.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1248 2024-09-14T21:51:07.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:07.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:07.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:07.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:07.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:07.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:07.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:07.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:08.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1250 2024-09-14T21:51:08.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1251 2024-09-14T21:51:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:08.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:08.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:08.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:09.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1253 2024-09-14T21:51:09.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1252 2024-09-14T21:51:09.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:09.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:09.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:09.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:51:09.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:09.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:09.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:51:09.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:51:10.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1254 2024-09-14T21:51:10.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1255 2024-09-14T21:51:10.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:10.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:10.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:11.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1257 2024-09-14T21:51:11.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1256 2024-09-14T21:51:11.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:11.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:11.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:11.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:11.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:11.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1259 2024-09-14T21:51:11.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:12.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1258 2024-09-14T21:51:12.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:12.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:12.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1260 2024-09-14T21:51:12.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1261 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:12.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:12.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:13.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:13.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1263 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:13.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1262 2024-09-14T21:51:13.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:13.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:14.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1265 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1264 2024-09-14T21:51:14.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:14.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:14.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:14.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:14.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:14.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:14.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:15.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:15.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:51:15.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:15.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:15.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:51:15.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:51:15.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1266 2024-09-14T21:51:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1267 2024-09-14T21:51:15.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:15.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:15.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:15.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:15.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:15.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:15.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:15.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:15.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:16.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1269 2024-09-14T21:51:16.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:17.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1268 2024-09-14T21:51:17.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:17.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:17.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:18.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1271 2024-09-14T21:51:18.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1270 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:18.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:18.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:18.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:18.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:18.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:18.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:19.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1272 2024-09-14T21:51:19.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1273 2024-09-14T21:51:19.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:19.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:19.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:19.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:51:19.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:51:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:51:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:20.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:20.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:20.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:20.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1274 2024-09-14T21:51:20.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1275 2024-09-14T21:51:20.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:20.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:21.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1276 2024-09-14T21:51:21.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1277 2024-09-14T21:51:21.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:21.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:21.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:21.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:21.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:21.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:21.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:21.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:21.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:21.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1279 2024-09-14T21:51:21.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:22.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1278 2024-09-14T21:51:22.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:22.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1281 2024-09-14T21:51:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1280 2024-09-14T21:51:22.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:22.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:22.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:23.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1282 2024-09-14T21:51:23.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1283 2024-09-14T21:51:23.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:23.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:23.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:23.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:23.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:23.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:24.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1284 2024-09-14T21:51:24.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1285 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:24.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:24.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:24.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:24.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:24.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:51:25.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:51:25.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:25.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:51:25.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:25.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:25.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:25.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1287 2024-09-14T21:51:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1286 2024-09-14T21:51:25.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:25.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:26.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:26.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:51:26.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:26.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:26.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:51:26.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:26.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:26.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1289 2024-09-14T21:51:26.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1288 2024-09-14T21:51:27.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:51:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:27.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:28.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1290 2024-09-14T21:51:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1291 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:51:28.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:51:28.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:28.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:28.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:28.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:28.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:28.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:28.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:28.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:29.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1293 2024-09-14T21:51:29.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1292 2024-09-14T21:51:29.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:29.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:29.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71356 2024-09-14T21:51:29.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1294 2024-09-14T21:51:29.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:29.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1295 2024-09-14T21:51:29.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:29.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:51:30.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:51:30.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1297 2024-09-14T21:51:30.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1296 2024-09-14T21:51:30.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:30.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1298 2024-09-14T21:51:31.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:51:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:51:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:51:31.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:31.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71488 2024-09-14T21:51:32.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1299 2024-09-14T21:51:32.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:51:32.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:32.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:32.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:51:32.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:51:32.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:32.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71620 2024-09-14T21:51:32.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:32.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71772 2024-09-14T21:51:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:51:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:51:32.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:51:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1300 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:51:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:51:33.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:33.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:33.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71925 2024-09-14T21:51:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72078 2024-09-14T21:51:35.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:35.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72231 2024-09-14T21:51:35.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1301 2024-09-14T21:51:35.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:36.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1302 2024-09-14T21:51:36.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:51:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72404 2024-09-14T21:51:38.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:51:38.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72578 2024-09-14T21:51:39.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:51:39.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:51:39.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71225 2024-09-14T21:54:05.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:05.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:05.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:05.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71357 2024-09-14T21:54:06.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:06.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:06.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:06.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71489 2024-09-14T21:54:07.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71621 2024-09-14T21:54:08.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:08.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:08.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:08.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71773 2024-09-14T21:54:09.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:09.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:09.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:09.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 71926 2024-09-14T21:54:10.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:10.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:10.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:10.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72079 2024-09-14T21:54:11.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:11.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:11.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:11.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72232 2024-09-14T21:54:12.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:12.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:12.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:12.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72405 2024-09-14T21:54:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:54:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 72579 2024-09-14T21:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T21:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T21:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:54:14.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T21:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T21:54:14.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T21:54:14.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T21:54:14.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T21:54:14.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T21:54:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T21:54:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T21:54:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T21:54:14.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:54:14.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T21:54:14.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T21:54:14.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:54:14.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78532 2024-09-14T21:54:14.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T21:54:14.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T21:54:14.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T21:54:14.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T21:54:14.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T21:54:14.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:54:14.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:54:15.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:54:15.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:54:15.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:54:15.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:54:15.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:54:15.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:54:15.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:54:15.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:54:15.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:54:15.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:05.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=582819631d669ca3ba9fee64348a66f6 2024-09-14T21:55:05.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T21:55:06.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T21:55:06.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:06.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:06.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:06.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T21:55:08.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T21:55:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:08.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0bec83801c8480cf7a0f280e25c0a520 2024-09-14T21:55:08.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T21:55:09.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:09.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:09.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:09.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:55:09.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T21:55:09.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:09.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:09.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:09.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:09.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:09.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:09.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:09.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:10.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=57f0c547ef64908be75913e0cbe59542 2024-09-14T21:55:10.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T21:55:10.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a67bad2fbfb8a39d51a734bf29b3003f 2024-09-14T21:55:10.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T21:55:10.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T21:55:10.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:10.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:10.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:10.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T21:55:10.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=84c6630d99750f14cf3be2c91bc2e5ed 2024-09-14T21:55:10.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T21:55:10.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T21:55:10.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:10.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:10.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:10.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T21:55:10.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=e3936cb5c95830c85a8c1714dcb7d666 2024-09-14T21:55:10.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T21:55:10.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T21:55:10.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:10.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:10.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:10.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T21:55:11.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:11.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T21:55:11.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:11.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T21:55:11.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:11.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T21:55:11.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:11.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:11.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:11.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:11.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:11.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:11.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:11.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:11.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:11.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:11.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:11.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:11.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:11.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:11.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:11.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:11.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:11.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=99175bb1b39f0a7eda50bd3668f2eae6 2024-09-14T21:55:11.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T21:55:11.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=00143e99cf2efc01e1a88ea1ab33f103 2024-09-14T21:55:11.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T21:55:11.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T21:55:11.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:11.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T21:55:11.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T21:55:11.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:11.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T21:55:11.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=25b3dc9269dd993b3ac0941c3e46ab81 2024-09-14T21:55:11.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T21:55:11.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T21:55:11.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:11.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:11.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:11.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T21:55:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:12.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:12.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:12.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:12.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:12.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:55:12.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:12.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:12.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:12.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:12.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:55:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T21:55:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:12.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T21:55:12.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:12.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T21:55:12.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:12.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:12.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:12.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:12.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:12.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:12.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:12.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:12.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:12.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=44a826cfaea033f4d0e4892c60f1f41b 2024-09-14T21:55:12.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T21:55:12.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T21:55:12.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:12.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:12.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:12.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:12.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:12.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:12.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:12.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T21:55:12.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:12.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:12.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:12.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T21:55:13.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:13.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:13.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:13.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:55:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:55:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:13.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:13.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:13.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:13.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:13.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:13.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:13.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:13.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:13.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:13.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:13.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:13.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:13.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:13.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:13.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:13.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:13.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:13.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T21:55:13.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:13.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:13.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T21:55:13.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:13.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:13.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:13.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:14.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:14.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:14.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:14.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:14.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:14.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:14.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:14.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:14.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:14.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:14.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:14.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:14.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:14.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:14.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:55:14.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:14.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:14.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:14.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:14.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:14.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:14.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:14.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:14.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:14.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:14.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:14.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:14.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:14.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:55:15.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:15.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:15.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:15.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:15.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:15.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:15.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:15.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:15.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:15.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:55:15.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:15.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:55:15.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:15.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:15.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:16.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:16.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:16.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:16.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:16.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:16.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:16.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:17.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:17.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:17.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:17.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:17.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:17.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:17.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:17.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T21:55:18.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:18.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:18.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:18.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:55:18.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:18.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:55:18.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:18.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:18.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:18.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:18.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:18.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:18.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:18.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:18.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:18.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:18.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:18.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:18.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:18.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:18.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:19.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:19.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:19.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:19.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:19.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:19.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:55:19.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:19.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:19.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:55:19.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:19.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:19.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:19.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:19.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:19.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:19.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:19.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:19.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:19.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:19.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:19.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:19.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:19.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:19.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:19.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:19.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:55:19.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:19.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:55:19.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:19.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:19.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:19.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:19.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:19.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:19.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:19.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:20.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:20.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:55:20.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:20.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:20.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:20.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:20.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:20.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:20.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:20.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:20.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:20.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:21.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:21.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:21.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:21.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:21.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:21.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:23.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:23.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:23.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:23.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:23.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:23.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:23.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:26.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:26.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:26.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:26.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:26.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:26.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:26.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:26.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:26.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:26.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:26.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:26.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:26.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:27.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:27.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:27.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:27.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:27.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:27.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:27.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:27.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:27.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:27.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:27.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:27.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:27.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:27.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:27.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:27.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:27.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:27.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:27.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:27.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:55:27.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:27.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:55:27.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:27.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:27.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:27.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:28.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:28.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:55:28.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:28.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:28.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:28.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:28.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:28.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:28.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:28.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:28.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:28.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:29.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:29.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:29.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:01' 2024-09-14T21:55:29.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:29.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T21:55:29.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:29.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:31.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:31.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:31.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:55:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:31.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:31.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:31.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:31.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:31.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:31.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:31.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:31.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:31.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:55:31.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:31.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:55:31.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:31.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:31.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:31.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T21:55:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:31.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:31.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:31.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:31.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:31.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:31.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:32.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:32.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:32.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:33.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:33.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:33.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:33.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:33.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:33.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:33.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:55:33.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:33.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:55:33.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:33.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:33.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:33.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:33.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:33.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:33.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T21:55:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:55:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T21:55:33.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T21:55:33.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T21:55:33.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T21:55:33.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:34.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:34.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:34.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:34.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:34.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:34.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:34.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:34.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:34.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:34.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:34.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:34.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:34.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:34.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:34.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:34.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:34.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:34.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:34.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:34.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:34.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:34.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:34.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:34.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:34.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:34.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:34.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:55:34.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:34.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:34.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:55:34.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:34.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:34.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:55:34.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:55:34.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:34.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:34.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:34.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:34.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:34.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:34.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:34.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:34.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:55:35.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:55:35.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:35.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:35.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:35.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:35.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:35.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:35.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:35.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T21:55:35.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T21:55:35.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:35.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:35.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:35.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:35.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:35.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:35.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:35.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:35.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:35.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:35.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:35.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:35.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:35.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:35.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:35.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:35.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:35.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:35.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:35.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:35.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:35.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:55:35.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:35.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:35.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:35.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:35.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:35.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:35.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:35.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:35.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:35.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:35.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:35.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:35.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:35.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:35.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:35.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:55:35.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:55:35.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:35.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:35.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:35.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:55:35.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:35.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:55:35.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:35.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:35.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:35.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:55:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:55:35.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:35.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:35.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:35.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:35.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:55:35.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:35.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:55:35.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:35.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:35.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:35.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:35.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:35.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:36.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:36.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:55:36.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:55:36.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:55:36.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:55:36.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:36.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:36.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:36.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:36.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T21:55:36.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:55:36.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:36.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:36.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:36.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:36.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:36.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:36.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:36.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:36.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:36.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:36.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:36.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:36.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:36.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:36.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:36.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:36.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:36.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:36.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:36.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:36.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:36.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:55:36.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:36.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:36.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:55:36.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:55:36.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:55:36.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:36.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:36.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:36.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:36.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:36.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:36.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:36.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:36.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:36.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:36.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:36.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T21:55:36.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:36.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:36.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T21:55:36.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T21:55:36.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T21:55:36.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T21:55:36.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:36.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T21:55:36.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:36.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T21:55:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T21:55:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T21:55:36.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:36.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:36.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:36.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:37.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:37.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:37.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:37.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:37.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:55:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:55:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:37.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:37.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:37.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:37.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:55:37.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:55:37.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:37.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:37.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:37.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:37.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:37.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:55:37.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:55:37.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:37.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:37.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T21:55:37.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:55:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:55:37.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T21:55:37.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:55:37.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:37.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T21:55:37.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:55:37.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:55:37.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T21:55:37.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:55:37.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:55:37.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:37.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T21:55:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:55:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:55:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:37.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:37.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:37.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:37.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:37.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:37.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:37.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:37.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:37.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:37.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:37.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:37.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:37.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:37.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:37.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:37.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:55:37.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:37.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:55:37.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:37.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:37.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:37.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:55:37.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:55:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T21:55:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:37.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:37.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:55:37.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T21:55:37.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:37.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:37.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:37.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T21:55:37.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:37.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:37.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T21:55:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T21:55:37.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:37.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:37.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:37.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:55:37.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T21:55:37.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:37.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T21:55:38.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T21:55:38.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T21:55:38.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:38.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T21:55:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T21:55:38.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:38.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:38.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:38.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:38.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:38.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:38.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:38.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:38.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:38.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:38.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:38.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:38.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:38.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:38.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:55:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:38.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:38.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:38.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:38.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:38.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:38.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T21:55:38.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:38.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:55:38.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:38.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:55:38.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:38.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:38.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:38.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:38.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:55:38.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:55:38.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:55:38.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:55:38.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:38.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:38.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:38.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:38.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:38.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:38.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:38.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:38.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:38.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:38.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:38.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:38.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:38.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:38.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:38.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:38.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:38.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:38.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:38.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:38.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:38.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:55:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:38.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:55:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:38.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:38.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:55:38.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:38.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T21:55:38.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:38.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:38.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:38.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:38.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T21:55:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T21:55:39.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T21:55:39.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:39.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T21:55:39.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T21:55:39.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T21:55:39.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:55:39.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:39.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:39.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T21:55:39.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:55:31' 2024-09-14T21:55:39.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T21:55:39.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T21:55:39.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:55:39.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T21:55:39.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:55:39.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:39.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:55:39.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:39.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:55:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:55:39.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:55:39.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 21:55:31' 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:55:31' 2024-09-14T21:55:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:55:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:55:39.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T21:55:39.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:39.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:39.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T21:55:40.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary678628126-d530-40ed-9621-744e92c5276dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 21:55:31' 2024-09-14T21:55:40.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:55:40.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:55:40.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:55:31' 2024-09-14T21:55:40.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:55:40.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T21:55:40.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T21:55:40.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T21:55:40.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T21:55:40.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:40.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:55:40.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T21:55:40.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:55:40.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:55:40.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:55:40.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T21:55:40.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T21:55:40.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T21:55:40.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T21:55:40.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:40.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T21:55:40.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:55:40.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:55:40.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T21:55:41.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T21:55:41.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T21:55:41.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T21:56:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=582819631d669ca3ba9fee64348a66f6 2024-09-14T21:56:27.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T21:56:27.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 582819631d669ca3ba9fee64348a66f6 != \5\8\2\8\1\9\6\3\1\d\6\6\9\c\a\3\b\a\9\f\e\e\6\4\3\4\8\a\6\6\f\6 ]] 2024-09-14T21:56:27.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:27.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78533 2024-09-14T21:56:30.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=84c6630d99750f14cf3be2c91bc2e5ed 2024-09-14T21:56:30.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T21:56:30.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0bec83801c8480cf7a0f280e25c0a520 2024-09-14T21:56:30.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T21:56:30.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 84c6630d99750f14cf3be2c91bc2e5ed != \8\4\c\6\6\3\0\d\9\9\7\5\0\f\1\4\c\f\3\b\e\2\c\9\1\b\c\2\e\5\e\d ]] 2024-09-14T21:56:30.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0bec83801c8480cf7a0f280e25c0a520 != \0\b\e\c\8\3\8\0\1\c\8\4\8\0\c\f\7\a\0\f\2\8\0\e\2\5\c\0\a\5\2\0 ]] 2024-09-14T21:56:30.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a67bad2fbfb8a39d51a734bf29b3003f 2024-09-14T21:56:30.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T21:56:31.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a67bad2fbfb8a39d51a734bf29b3003f != \a\6\7\b\a\d\2\f\b\f\b\8\a\3\9\d\5\1\a\7\3\4\b\f\2\9\b\3\0\0\3\f ]] 2024-09-14T21:56:32.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=e3936cb5c95830c85a8c1714dcb7d666 2024-09-14T21:56:32.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T21:56:32.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ e3936cb5c95830c85a8c1714dcb7d666 != \e\3\9\3\6\c\b\5\c\9\5\8\3\0\c\8\5\a\8\c\1\7\1\4\d\c\b\7\d\6\6\6 ]] 2024-09-14T21:56:32.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=57f0c547ef64908be75913e0cbe59542 2024-09-14T21:56:32.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T21:56:32.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=99175bb1b39f0a7eda50bd3668f2eae6 2024-09-14T21:56:32.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T21:56:33.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 99175bb1b39f0a7eda50bd3668f2eae6 != \9\9\1\7\5\b\b\1\b\3\9\f\0\a\7\e\d\a\5\0\b\d\3\6\6\8\f\2\e\a\e\6 ]] 2024-09-14T21:56:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 57f0c547ef64908be75913e0cbe59542 != \5\7\f\0\c\5\4\7\e\f\6\4\9\0\8\b\e\7\5\9\1\3\e\0\c\b\e\5\9\5\4\2 ]] 2024-09-14T21:56:33.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=44a826cfaea033f4d0e4892c60f1f41b 2024-09-14T21:56:33.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T21:56:33.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 44a826cfaea033f4d0e4892c60f1f41b != \4\4\a\8\2\6\c\f\a\e\a\0\3\3\f\4\d\0\e\4\8\9\2\c\6\0\f\1\f\4\1\b ]] 2024-09-14T21:56:33.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:33.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78535 2024-09-14T21:56:33.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:33.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78537 2024-09-14T21:56:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=00143e99cf2efc01e1a88ea1ab33f103 2024-09-14T21:56:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T21:56:33.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 00143e99cf2efc01e1a88ea1ab33f103 != \0\0\1\4\3\e\9\9\c\f\2\e\f\c\0\1\e\1\a\8\8\e\a\1\a\b\3\3\f\1\0\3 ]] 2024-09-14T21:56:34.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=25b3dc9269dd993b3ac0941c3e46ab81 2024-09-14T21:56:34.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T21:56:34.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 25b3dc9269dd993b3ac0941c3e46ab81 != \2\5\b\3\d\c\9\2\6\9\d\d\9\9\3\b\3\a\c\0\9\4\1\c\3\e\4\6\a\b\8\1 ]] 2024-09-14T21:56:34.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78539 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78541 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78543 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78544 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78548 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 78550 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:56:34.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:35.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:35.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:35.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: aac85ed2-ee0f-4c69-9622-f6494fa9f205 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3175219.2,"bytes_per_snapshot":63504384.0,"last_snapshot_bytes":63504384,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350933,"remote_snapshot_timestamp":1726350933,"replay_state":"idle"} 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:35.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:35.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:35.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3175219.2,"bytes_per_snapshot":63504384.0,"last_snapshot_bytes":63504384,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350933,"remote_snapshot_timestamp":1726350933,"replay_state":"idle"} 2024-09-14T21:56:35.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:35.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:35.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:35.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:35.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:35.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:35.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:35.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:35.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:35.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:35.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:35.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:36.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1aac85ed2-ee0f-4c69-9622-f6494fa9f205up+replayingreplaying, {"bytes_per_second":3175219.2,"bytes_per_snapshot":63504384.0,"last_snapshot_bytes":63504384,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350933,"remote_snapshot_timestamp":1726350933,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+replayingreplaying, {"bytes_per_second":3384729.6,"bytes_per_snapshot":67694592.0,"last_snapshot_bytes":67694592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350939,"remote_snapshot_timestamp":1726350939,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+replayingreplaying, {"bytes_per_second":3254067.2,"bytes_per_snapshot":65081344.0,"last_snapshot_bytes":65081344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+replayingreplaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:36.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:36.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T21:56:36.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:36.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T21:56:36.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:36.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:36.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:36.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:36.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T21:56:36.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T21:56:36.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:36.323+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80eb60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:36.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:36.324+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcac80 [3/aac85ed2-ee0f-4c69-9622-f6494fa9f205] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:37.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:37.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T21:56:37.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:37.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:37.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:56:37.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:37.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:37.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T21:56:37.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:37.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:37.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:37.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:37.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:37.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:37.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:37.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:38.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:38.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T21:56:39.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3384729.6,"bytes_per_snapshot":67694592.0,"last_snapshot_bytes":67694592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350939,"remote_snapshot_timestamp":1726350939,"replay_state":"idle"} 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:39.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:39.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:39.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:39.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3384729.6,"bytes_per_snapshot":67694592.0,"last_snapshot_bytes":67694592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350939,"remote_snapshot_timestamp":1726350939,"replay_state":"idle"} 2024-09-14T21:56:39.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:39.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:39.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:39.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:39.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:39.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:39.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:39.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:39.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:39.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary2206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42up+replayingreplaying, {"bytes_per_second":3384729.6,"bytes_per_snapshot":67694592.0,"last_snapshot_bytes":67694592,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350939,"remote_snapshot_timestamp":1726350939,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+replayingreplaying, {"bytes_per_second":3254067.2,"bytes_per_snapshot":65081344.0,"last_snapshot_bytes":65081344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+replayingreplaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:39.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T21:56:39.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:39.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T21:56:39.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:39.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:39.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:39.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:39.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T21:56:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T21:56:39.447 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:39.445+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5887a4000 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:39.447 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:39.445+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaf00 [3/206a8c91-8c5c-43f1-b3bc-4f02fd2b1f42] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:40.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:40.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T21:56:40.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:40.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T21:56:40.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T21:56:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:41.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:41.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:41.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:41.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:41.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f9106924-17aa-4c1b-b38b-340cdafb2014 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3254067.2,"bytes_per_snapshot":65081344.0,"last_snapshot_bytes":65081344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"} 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:42.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:42.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:42.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:42.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3254067.2,"bytes_per_snapshot":65081344.0,"last_snapshot_bytes":65081344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"} 2024-09-14T21:56:42.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:42.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:42.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:42.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:42.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:42.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:42.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:42.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:42.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:42.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:42.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:42.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary3f9106924-17aa-4c1b-b38b-340cdafb2014up+replayingreplaying, {"bytes_per_second":3254067.2,"bytes_per_snapshot":65081344.0,"last_snapshot_bytes":65081344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+replayingreplaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:42.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:42.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T21:56:42.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:42.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T21:56:42.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:42.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:42.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:42.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:42.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T21:56:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T21:56:42.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:42.413+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7ec820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:42.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:42.413+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/f9106924-17aa-4c1b-b38b-340cdafb2014] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:43.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:43.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:43.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T21:56:43.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:43.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:43.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:43.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T21:56:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:44.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:44.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:44.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:44.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:44.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T21:56:44.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58a06992-b152-4ed6-832f-89720e8466f3 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"} 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:44.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:44.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:44.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:44.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"} 2024-09-14T21:56:44.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:44.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:44.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:44.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:44.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:44.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:44.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:44.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:44.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:44.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:44.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:44.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:44.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:45.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary458a06992-b152-4ed6-832f-89720e8466f3up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350940,"remote_snapshot_timestamp":1726350940,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+replayingreplaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:45.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:45.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T21:56:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T21:56:45.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:45.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:45.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:45.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:45.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:45.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T21:56:45.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T21:56:45.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:45.228+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a405520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:45.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:45.228+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/58a06992-b152-4ed6-832f-89720e8466f3] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:46.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:46.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T21:56:46.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:46.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:46.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:56:46.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:46.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:46.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T21:56:46.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:46.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:46.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:46.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:47.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T21:56:47.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T21:56:47.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e333ed88-3ff4-4cdf-8b94-9998cf8f5264 2024-09-14T21:56:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"} 2024-09-14T21:56:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:47.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:47.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:47.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"} 2024-09-14T21:56:47.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:47.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:47.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:47.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:47.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:47.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:47.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:47.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:47.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:48.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary5e333ed88-3ff4-4cdf-8b94-9998cf8f5264up+replayingreplaying, {"bytes_per_second":3341721.6,"bytes_per_snapshot":66834432.0,"last_snapshot_bytes":66834432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:48.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:48.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T21:56:48.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:48.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T21:56:48.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:48.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:48.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:48.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T21:56:48.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T21:56:48.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:48.269+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80f1e0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:48.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:48.269+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/e333ed88-3ff4-4cdf-8b94-9998cf8f5264] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:49.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:49.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T21:56:49.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:49.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T21:56:49.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:49.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:50.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:50.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:50.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T21:56:50.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T21:56:50.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 78628126-d530-40ed-9621-744e92c5276d 2024-09-14T21:56:50.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:50.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:56:50.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:50.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:50.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:50.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:50.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:50.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:56:50.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:50.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:50.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:50.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:50.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:50.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:50.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:50.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:50.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:50.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:50.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:51.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary678628126-d530-40ed-9621-744e92c5276dup+replayingreplaying, {"bytes_per_second":3213721.6,"bytes_per_snapshot":64274432.0,"last_snapshot_bytes":64274432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:51.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:51.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T21:56:51.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:51.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T21:56:51.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:51.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:51.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:51.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:51.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:51.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T21:56:51.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:51.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:51.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:51.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T21:56:51.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T21:56:51.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:51.426+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7ec820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:51.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:51.426+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/78628126-d530-40ed-9621-744e92c5276d] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:52.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:52.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T21:56:52.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:52.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:52.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:56:52.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:52.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:52.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T21:56:52.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:52.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T21:56:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:56:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T21:56:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:53.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T21:56:53.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:53.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:53.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T21:56:53.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f8272058-2db4-47fd-b92d-40be814a8f6b 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"} 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:53.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:53.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:53.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:53.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"} 2024-09-14T21:56:53.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:53.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:53.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:53.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:53.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:53.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:53.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:53.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:53.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:53.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:53.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:53.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:53.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:54.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary7f8272058-2db4-47fd-b92d-40be814a8f6bup+replayingreplaying, {"bytes_per_second":3353190.4,"bytes_per_snapshot":67063808.0,"last_snapshot_bytes":67063808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350936,"remote_snapshot_timestamp":1726350936,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:54.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:54.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T21:56:54.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:54.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T21:56:54.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:54.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:54.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:54.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T21:56:54.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T21:56:54.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:54.249+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589cc21a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:54.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:54.249+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/f8272058-2db4-47fd-b92d-40be814a8f6b] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:55.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:55.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T21:56:55.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:55.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:55.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:55.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:56.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T21:56:56.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T21:56:56.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d25498a5-2e80-41ba-adef-c77139cc49b8 2024-09-14T21:56:56.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:56:56.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"} 2024-09-14T21:56:56.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:56:56.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:56:56.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:56:56.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:56:56.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:56:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"} 2024-09-14T21:56:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:56:56.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:56.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:56:56.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:56.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:56:56.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:56:56.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:56:56.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:56:56.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:56.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:56:57.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary8d25498a5-2e80-41ba-adef-c77139cc49b8up+replayingreplaying, {"bytes_per_second":3308339.2,"bytes_per_snapshot":66166784.0,"last_snapshot_bytes":66166784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350938,"remote_snapshot_timestamp":1726350938,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:56:57.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:56:57.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T21:56:57.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:56:57.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T21:56:57.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:56:57.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:56:57.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:56:57.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T21:56:57.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T21:56:57.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:57.289+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80e9c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:56:57.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:56:57.289+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/d25498a5-2e80-41ba-adef-c77139cc49b8] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:56:58.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:56:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T21:56:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:56:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:56:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T21:56:58.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:56:58.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:56:58.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:56:59.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:56:59.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T21:57:00.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T21:57:00.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2c497102-f083-4f2b-a7bc-45ba773a3406 2024-09-14T21:57:00.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:57:00.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:57:00.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:57:00.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:56:31' 2024-09-14T21:57:00.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:57:00.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:57:00.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:57:00.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:57:00.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:57:00.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:57:00.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:57:00.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:57:00.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:57:00.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:57:00.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:57:00.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 21:56:31' 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:56:31' 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:57:00.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:57:00.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:57:00.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":3333120.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31image-primary92c497102-f083-4f2b-a7bc-45ba773a3406up+replayingreplaying, {"bytes_per_second":3332915.2,"bytes_per_snapshot":66658304.0,"last_snapshot_bytes":66658304,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:56:31' 2024-09-14T21:57:00.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:57:00.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T21:57:00.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:56:31' 2024-09-14T21:57:00.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T21:57:00.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:57:00.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:57:00.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:57:00.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:57:00.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:00.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:00.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T21:57:00.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:57:00.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:00.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:00.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T21:57:00.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T21:57:00.435 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:00.432+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b591c7b520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:57:00.435 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:00.432+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/2c497102-f083-4f2b-a7bc-45ba773a3406] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:57:01.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:01.188+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588b26820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:57:01.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:01.188+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/2c497102-f083-4f2b-a7bc-45ba773a3406] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:57:01.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:57:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T21:57:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:57:01.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:57:01.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T21:57:01.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:01.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:01.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:57:01.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T21:57:02.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T21:57:02.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:57:02.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a14e2a89-a6c6-4deb-86dc-cc87ae57f003 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T21:57:02.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 21:57:01' 2024-09-14T21:57:02.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T21:57:02.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T21:57:02.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T21:57:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"} 2024-09-14T21:57:02.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T21:57:02.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:57:02.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T21:57:02.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:57:02.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T21:57:02.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T21:57:02.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T21:57:02.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T21:57:02.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:57:01' 2024-09-14T21:57:02.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 21:57:01' 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 21:57:01' 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T21:57:02.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T21:57:02.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T21:57:03.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10a14e2a89-a6c6-4deb-86dc-cc87ae57f003up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66662400.0,"last_snapshot_bytes":66662400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726350937,"remote_snapshot_timestamp":1726350937,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 21:57:01' 2024-09-14T21:57:03.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T21:57:03.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T21:57:03.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 21:57:01' 2024-09-14T21:57:03.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T21:57:03.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T21:57:03.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T21:57:03.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T21:57:03.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T21:57:03.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T21:57:03.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:03.301+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7eb6c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T21:57:03.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T21:57:03.301+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/a14e2a89-a6c6-4deb-86dc-cc87ae57f003] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T21:57:04.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T21:57:04.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T21:57:04.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T21:57:04.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:04.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T21:57:04.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T21:57:04.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T21:57:04.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:04.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T21:57:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T21:57:05.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:05.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 241fb9adcbe9 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.241fb9adcbe9 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:05.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:04 2024 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:04 2024 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:04 2024 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T21:57:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:05.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:05.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T21:57:05.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T21:57:05.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:05.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T21:57:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:05.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 056a29da-7d92-4981-8152-fbc5fb43f317 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:05.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:05.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:05.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:05.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:05.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T21:57:05.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T21:57:05.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:05.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:06.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:06.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:06.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:06.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:06.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T21:57:06.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:06.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T21:57:06.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:06.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1324 2024-09-14T21:57:06.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:06.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 242f371c14b2 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.242f371c14b2 2024-09-14T21:57:06.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:06 2024 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:06 2024 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:06 2024 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T21:57:06.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:06.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:06.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:06.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T21:57:06.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T21:57:06.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:06.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T21:57:06.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:06.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:06.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:06.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 623bd43a-726c-44aa-b7ef-123e4ca03869 2024-09-14T21:57:06.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:06.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:06.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:06.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:06.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:06.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:06.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:06.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:06.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T21:57:06.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T21:57:07.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:07.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:07.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T21:57:07.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T21:57:07.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T21:57:07.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:07.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T21:57:07.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:07.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T21:57:07.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:07.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T21:57:07.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:07.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1326 2024-09-14T21:57:07.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T21:57:07.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T21:57:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:07.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 243c49725bdb 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.243c49725bdb 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:07 2024 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:07 2024 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:07 2024 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T21:57:07.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:07.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:07.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:07.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T21:57:07.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T21:57:07.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:07.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T21:57:07.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b6ca77ab-9ce5-40b0-93d3-1b86bbf34c9b 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:07.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:07.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:07.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:07.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T21:57:07.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T21:57:08.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:08.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T21:57:08.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T21:57:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T21:57:08.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:08.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1328 2024-09-14T21:57:08.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T21:57:08.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 244b45bff167 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.244b45bff167 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:08 2024 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:08 2024 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:08 2024 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T21:57:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:08.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:08.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:08.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T21:57:08.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T21:57:08.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:08.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T21:57:08.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 3d1af0fa-1b30-4095-a4f0-ddc8072604af 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:08.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:08.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:08.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:08.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:08.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T21:57:08.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T21:57:08.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:08.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T21:57:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T21:57:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T21:57:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T21:57:09.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:09.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:09.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T21:57:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:09.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T21:57:09.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:09.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1330 2024-09-14T21:57:09.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:09.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:09.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T21:57:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:09.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 24594f512c00 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.24594f512c00 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:09 2024 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:09 2024 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:09 2024 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T21:57:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:09.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:09.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:09.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T21:57:09.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T21:57:09.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:09.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T21:57:09.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: a19496af-2192-4bde-ac9e-2c565709b2ec 2024-09-14T21:57:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:09.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:09.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:09.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:09.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T21:57:09.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T21:57:09.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:10.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T21:57:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T21:57:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T21:57:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T21:57:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T21:57:10.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:10.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T21:57:10.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:10.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1332 2024-09-14T21:57:10.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1333 2024-09-14T21:57:10.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T21:57:10.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:10.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:10.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:10.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2469c95d368a 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2469c95d368a 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:10.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:10 2024 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:10 2024 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:10 2024 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T21:57:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:10.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:10.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:10.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T21:57:10.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T21:57:10.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:10.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T21:57:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 4378a1ed-edea-410c-b4d2-156e1165743e 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:10.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:10.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:10.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:10.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T21:57:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T21:57:11.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:11.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:11.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:11.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:11.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T21:57:11.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T21:57:11.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T21:57:11.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T21:57:11.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T21:57:11.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:11.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T21:57:11.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:11.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1336 2024-09-14T21:57:11.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1335 2024-09-14T21:57:11.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:11.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:11.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:11.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:11.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:11.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:11.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:11.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T21:57:11.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 247b22307a9d 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.247b22307a9d 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:11.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:11 2024 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:11 2024 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:11 2024 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T21:57:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:11.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:11.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:11.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T21:57:11.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T21:57:11.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:11.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T21:57:11.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 19c72b8a-7f2d-4f36-9c99-8445ff4312d6 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:11.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:11.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:11.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:11.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:11.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:11.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:11.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T21:57:11.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T21:57:12.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:12.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T21:57:12.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:12.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T21:57:12.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T21:57:12.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:12.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T21:57:12.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:12.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T21:57:12.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:12.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1339 2024-09-14T21:57:12.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1338 2024-09-14T21:57:12.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T21:57:12.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:12.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:12.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 248c5d63a16 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.248c5d63a16 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:12.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:12 2024 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:12 2024 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:12 2024 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T21:57:12.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T21:57:12.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T21:57:12.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:12.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T21:57:12.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: cb6c1b0d-c646-4eb7-9aa3-dace432d910d 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:12.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:12.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:12.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:12.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T21:57:12.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T21:57:13.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:13.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:13.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:13.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T21:57:13.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:13.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:13.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T21:57:13.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:13.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T21:57:13.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:13.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1341 2024-09-14T21:57:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:13.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1342 2024-09-14T21:57:13.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T21:57:13.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:13.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T21:57:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 249ec3588cd9 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.249ec3588cd9 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:13 2024 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:13 2024 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:13 2024 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T21:57:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:13.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:13.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:13.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T21:57:14.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T21:57:14.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:14.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T21:57:14.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:14.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:14.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:14.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 60b52d24-38dd-448e-a16a-5a17033ad5dd 2024-09-14T21:57:14.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:14.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:14.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:14.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:14.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:14.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:14.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:14.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:14.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T21:57:14.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T21:57:14.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:14.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T21:57:14.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:14.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T21:57:14.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T21:57:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T21:57:14.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T21:57:14.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T21:57:14.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T21:57:14.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T21:57:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T21:57:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T21:57:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:14.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T21:57:14.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:14.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:14.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:14.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:14.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:14.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:14.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:14.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:14.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:14.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1344 2024-09-14T21:57:14.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1346 2024-09-14T21:57:14.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T21:57:14.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1345 2024-09-14T21:57:14.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:14.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:14.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:14.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 24b22661d90c 2024-09-14T21:57:14.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.24b22661d90c 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 21:57:14 2024 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 21:57:14 2024 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 21:57:14 2024 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T21:57:14.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T21:57:14.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T21:57:14.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T21:57:14.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T21:57:15.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T21:57:15.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T21:57:15.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T21:57:15.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T21:57:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T21:57:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T21:57:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: edf23b92-320f-4be7-aa1b-348f883b50f6 2024-09-14T21:57:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T21:57:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T21:57:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T21:57:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T21:57:15.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T21:57:15.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T21:57:15.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T21:57:15.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T21:57:15.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T21:57:15.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T21:57:15.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83173 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T21:57:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T21:57:15.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:15.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:15.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:15.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:15.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:15.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:15.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T21:57:15.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T21:57:15.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1348 2024-09-14T21:57:15.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1350 2024-09-14T21:57:15.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1349 2024-09-14T21:57:15.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:15.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:15.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:16.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:16.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:16.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:16.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:16.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:16.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:16.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:16.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:16.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:16.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:16.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:16.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:16.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1352 2024-09-14T21:57:16.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1351 2024-09-14T21:57:16.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:17.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1353 2024-09-14T21:57:17.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1354 2024-09-14T21:57:17.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:17.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:17.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:17.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:18.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1356 2024-09-14T21:57:18.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1355 2024-09-14T21:57:18.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1357 2024-09-14T21:57:18.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:18.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:18.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:18.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:18.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:19.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1358 2024-09-14T21:57:19.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1360 2024-09-14T21:57:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1359 2024-09-14T21:57:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:19.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:19.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:19.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:19.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:19.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:19.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:19.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:20.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:20.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:20.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:20.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:20.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:20.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:20.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1362 2024-09-14T21:57:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1361 2024-09-14T21:57:20.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:20.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:21.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:21.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:21.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:21.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:21.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:21.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:21.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:21.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:21.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:21.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:21.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:21.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1364 2024-09-14T21:57:21.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1363 2024-09-14T21:57:21.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:21.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:22.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1366 2024-09-14T21:57:22.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1365 2024-09-14T21:57:22.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:22.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1367 2024-09-14T21:57:22.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:22.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:22.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:22.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:22.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:22.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:22.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:22.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:22.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:22.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:22.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:22.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:23.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1370 2024-09-14T21:57:23.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1368 2024-09-14T21:57:23.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:23.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:23.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1369 2024-09-14T21:57:23.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:23.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:23.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:23.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:24.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1372 2024-09-14T21:57:24.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:24.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1371 2024-09-14T21:57:24.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:24.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:24.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:24.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:24.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:24.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:24.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:24.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:24.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:24.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:24.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:25.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:25.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1373 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:25.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:25.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:25.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1374 2024-09-14T21:57:25.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:26.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:26.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:26.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:26.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:26.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:26.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:26.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:26.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1377 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:26.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:26.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1375 2024-09-14T21:57:26.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:27.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1379 2024-09-14T21:57:27.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1378 2024-09-14T21:57:27.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:27.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:27.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:27.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:27.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:27.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:27.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:27.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:27.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:27.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:27.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:27.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:27.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:27.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:28.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1376 2024-09-14T21:57:28.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:28.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1381 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:28.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:28.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:28.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:29.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1380 2024-09-14T21:57:29.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:29.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1384 2024-09-14T21:57:29.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:29.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:29.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:29.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:29.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:29.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:29.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:29.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:30.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1382 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:30.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:30.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:30.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:30.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:30.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:30.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:30.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:30.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1385 2024-09-14T21:57:30.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1383 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:31.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:31.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:31.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1387 2024-09-14T21:57:31.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:31.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:32.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1386 2024-09-14T21:57:32.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:32.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:32.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1389 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:32.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:33.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1388 2024-09-14T21:57:33.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:33.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:33.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:33.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:33.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:33.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:33.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:33.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1391 2024-09-14T21:57:33.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:34.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1390 2024-09-14T21:57:34.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:34.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:34.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:34.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:34.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:34.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:34.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1393 2024-09-14T21:57:34.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:35.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1392 2024-09-14T21:57:35.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:35.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1396 2024-09-14T21:57:35.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:36.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1394 2024-09-14T21:57:36.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:36.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:36.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:36.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1397 2024-09-14T21:57:36.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:36.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:36.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:36.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:37.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1395 2024-09-14T21:57:37.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:37.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1399 2024-09-14T21:57:37.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:37.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:38.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1398 2024-09-14T21:57:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:38.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1401 2024-09-14T21:57:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:38.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:38.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:39.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1400 2024-09-14T21:57:39.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:39.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:39.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:39.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:39.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:39.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:39.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:39.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1403 2024-09-14T21:57:39.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:39.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:39.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:39.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:39.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:39.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:39.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:40.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:40.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1402 2024-09-14T21:57:40.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:40.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:40.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:40.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:40.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:40.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:40.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1405 2024-09-14T21:57:40.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:41.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1404 2024-09-14T21:57:41.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:41.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:41.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:41.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:41.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:41.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:41.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:41.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1407 2024-09-14T21:57:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:42.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1406 2024-09-14T21:57:42.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:42.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:42.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:42.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:42.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:42.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:42.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:42.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:42.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1409 2024-09-14T21:57:42.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:43.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1408 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:43.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:43.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:43.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:43.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:43.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:43.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:43.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:43.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:43.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1411 2024-09-14T21:57:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:44.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1410 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:44.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:44.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:44.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:44.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:44.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:44.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:44.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:44.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:44.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1413 2024-09-14T21:57:44.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:45.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:45.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:45.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:45.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:45.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:45.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:45.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1412 2024-09-14T21:57:45.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:45.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1415 2024-09-14T21:57:45.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:45.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:45.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:45.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:45.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:45.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:45.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:46.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1414 2024-09-14T21:57:46.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:46.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:46.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:46.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1417 2024-09-14T21:57:46.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:46.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:46.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:46.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:46.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:46.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:46.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:47.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1416 2024-09-14T21:57:47.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:47.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1419 2024-09-14T21:57:47.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:47.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:47.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:48.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1418 2024-09-14T21:57:48.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:48.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1421 2024-09-14T21:57:48.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:48.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:48.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:48.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:48.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:48.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:48.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:48.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:49.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1420 2024-09-14T21:57:49.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:49.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1423 2024-09-14T21:57:49.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:49.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:49.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:50.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1422 2024-09-14T21:57:50.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:50.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:50.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:50.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:50.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:50.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:50.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:50.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1425 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:50.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:51.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1424 2024-09-14T21:57:51.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:51.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:51.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:51.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:51.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:51.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:51.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:51.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:51.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:51.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:51.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:51.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:51.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:51.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1427 2024-09-14T21:57:51.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:52.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1426 2024-09-14T21:57:52.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:52.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:52.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:52.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:52.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:52.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:52.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:52.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:52.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1429 2024-09-14T21:57:52.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:53.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1428 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:53.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:53.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:53.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1430 2024-09-14T21:57:53.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:53.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:53.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:53.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1431 2024-09-14T21:57:53.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:54.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1432 2024-09-14T21:57:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:54.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:54.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:54.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:54.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1433 2024-09-14T21:57:54.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:57:54.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:55.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:55.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1435 2024-09-14T21:57:55.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:57:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:55.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:55.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:57:55.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:57:56.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1434 2024-09-14T21:57:56.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:57:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:57:56.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1437 2024-09-14T21:57:56.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:56.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:57:56.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:56.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:56.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:57:56.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:57:56.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:57:56.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:57:57.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1436 2024-09-14T21:57:57.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:57.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:57.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:57:57.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:57.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:57.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:57:57.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:57:57.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:57.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:57:57.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:57.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:57.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:57:57.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:57:57.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1439 2024-09-14T21:57:57.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:58.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1438 2024-09-14T21:57:58.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:58.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:58.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:57:58.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:58.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:58.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:57:58.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:57:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:57:59.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:57:59.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:57:59.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:57:59.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:57:59.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:57:59.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:57:59.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1440 2024-09-14T21:57:59.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1441 2024-09-14T21:57:59.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:57:59.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:00.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1442 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:00.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:00.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1443 2024-09-14T21:58:00.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:00.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1444 2024-09-14T21:58:00.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:00.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:00.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:00.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:00.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:00.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:00.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:00.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:00.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1445 2024-09-14T21:58:00.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:01.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:01.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:01.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:01.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:01.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:01.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:01.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1446 2024-09-14T21:58:01.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:01.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1447 2024-09-14T21:58:01.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:02.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1449 2024-09-14T21:58:02.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:02.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:03.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1448 2024-09-14T21:58:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:03.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1451 2024-09-14T21:58:03.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1450 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:03.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:03.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:03.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:03.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:03.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:03.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:03.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:03.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:03.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:03.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:03.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:03.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:03.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:03.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:03.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:03.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:03.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:03.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:03.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:03.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:04.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1452 2024-09-14T21:58:04.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:04.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1453 2024-09-14T21:58:04.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:04.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:04.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:04.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:04.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:04.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:04.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:05.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:05.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:05.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:05.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:05.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:05.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:06.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1454 2024-09-14T21:58:06.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1455 2024-09-14T21:58:06.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:06.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:06.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:06.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:06.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:06.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:06.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:06.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:06.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:06.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:06.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:07.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1456 2024-09-14T21:58:07.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1457 2024-09-14T21:58:07.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:07.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:07.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1459 2024-09-14T21:58:07.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:07.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:08.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1458 2024-09-14T21:58:08.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1461 2024-09-14T21:58:09.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1460 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:09.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:09.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:09.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:09.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:10.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:10.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:10.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:10.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:10.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:10.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:10.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:10.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1462 2024-09-14T21:58:10.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1463 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:10.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:10.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:10.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:10.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1464 2024-09-14T21:58:10.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1465 2024-09-14T21:58:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:11.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1467 2024-09-14T21:58:11.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:11.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1466 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:11.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1469 2024-09-14T21:58:12.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:13.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1468 2024-09-14T21:58:13.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:13.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:13.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:13.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:13.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:13.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:13.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:13.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:13.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1471 2024-09-14T21:58:13.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1470 2024-09-14T21:58:13.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:13.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:13.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:13.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:13.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:13.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:14.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:14.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1472 2024-09-14T21:58:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1473 2024-09-14T21:58:14.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:15.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:16.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1474 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:16.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:16.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1475 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:16.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:16.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:16.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:16.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:17.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1476 2024-09-14T21:58:17.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1477 2024-09-14T21:58:17.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:17.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:17.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1479 2024-09-14T21:58:17.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:17.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:17.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:17.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:18.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1478 2024-09-14T21:58:18.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1480 2024-09-14T21:58:19.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1481 2024-09-14T21:58:19.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:19.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:19.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:19.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:19.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:19.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:19.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:19.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:19.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:20.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1483 2024-09-14T21:58:20.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1482 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:20.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:20.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:20.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:20.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:20.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:20.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:20.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1485 2024-09-14T21:58:20.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1484 2024-09-14T21:58:20.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:20.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:20.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:20.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:20.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:20.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:20.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:20.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:21.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1486 2024-09-14T21:58:21.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1487 2024-09-14T21:58:21.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:21.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:21.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:22.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1489 2024-09-14T21:58:22.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:22.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:22.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:22.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:22.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:22.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:22.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:22.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:23.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1488 2024-09-14T21:58:23.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:23.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1490 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:23.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:23.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1491 2024-09-14T21:58:23.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:23.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:23.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:24.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1493 2024-09-14T21:58:24.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1492 2024-09-14T21:58:24.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:24.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:24.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:24.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:24.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:24.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:24.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:24.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:24.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:25.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:25.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:25.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:25.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:25.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:25.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:26.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:26.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1495 2024-09-14T21:58:26.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1494 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:26.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:26.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:26.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1497 2024-09-14T21:58:27.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1496 2024-09-14T21:58:27.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:27.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:27.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:27.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:27.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:27.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:27.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:27.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:27.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:27.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1499 2024-09-14T21:58:27.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:28.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1498 2024-09-14T21:58:28.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:29.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1500 2024-09-14T21:58:29.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1501 2024-09-14T21:58:29.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:29.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:29.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:29.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:30.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1502 2024-09-14T21:58:30.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:30.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1503 2024-09-14T21:58:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:30.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:30.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:30.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1505 2024-09-14T21:58:30.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1504 2024-09-14T21:58:30.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:30.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:31.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1506 2024-09-14T21:58:31.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1507 2024-09-14T21:58:31.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:31.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:31.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:31.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:31.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:31.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:31.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:31.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1509 2024-09-14T21:58:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:32.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:32.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:32.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:32.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:32.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:32.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:32.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:32.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:32.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:32.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:32.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:32.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1508 2024-09-14T21:58:33.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:33.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1511 2024-09-14T21:58:33.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1510 2024-09-14T21:58:33.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:33.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:33.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:33.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:34.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1513 2024-09-14T21:58:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1512 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:34.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:34.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:34.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:35.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:35.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:35.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:35.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:35.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:35.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:36.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:36.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:36.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:36.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:36.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:36.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:36.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:36.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:36.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1515 2024-09-14T21:58:36.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1514 2024-09-14T21:58:36.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:36.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1516 2024-09-14T21:58:37.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1517 2024-09-14T21:58:37.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:37.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1519 2024-09-14T21:58:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:37.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:37.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:38.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1518 2024-09-14T21:58:38.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:39.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1520 2024-09-14T21:58:39.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1521 2024-09-14T21:58:39.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:39.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:39.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:39.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:39.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:39.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:39.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1522 2024-09-14T21:58:39.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1523 2024-09-14T21:58:39.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:39.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:40.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1524 2024-09-14T21:58:40.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1525 2024-09-14T21:58:40.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:40.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:40.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1526 2024-09-14T21:58:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1527 2024-09-14T21:58:41.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:41.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:41.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:41.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:41.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:41.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:41.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:41.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:42.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1528 2024-09-14T21:58:42.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:42.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1529 2024-09-14T21:58:42.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:42.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:42.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:42.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:42.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:42.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:42.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:42.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:42.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:42.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:42.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:42.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:42.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:42.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:42.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:42.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:42.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:43.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1531 2024-09-14T21:58:43.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1530 2024-09-14T21:58:43.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:43.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:43.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:43.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:43.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:43.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:43.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:43.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:44.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1533 2024-09-14T21:58:44.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1532 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:44.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:44.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:44.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:44.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:45.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:45.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:45.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:45.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:45.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:45.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:45.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:45.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1535 2024-09-14T21:58:45.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1534 2024-09-14T21:58:45.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:45.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:46.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1537 2024-09-14T21:58:46.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1536 2024-09-14T21:58:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:46.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:46.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:47.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1538 2024-09-14T21:58:47.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1539 2024-09-14T21:58:47.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:47.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:48.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:48.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:48.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:48.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:48.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:48.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:48.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:48.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:48.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:48.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:48.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:48.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:49.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1540 2024-09-14T21:58:49.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1541 2024-09-14T21:58:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:49.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:49.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:49.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:49.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:49.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:49.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:49.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:49.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:50.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1543 2024-09-14T21:58:50.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1542 2024-09-14T21:58:50.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:50.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:50.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:50.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:50.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:50.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:50.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:50.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:50.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:50.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:50.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:50.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:50.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:50.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:51.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1545 2024-09-14T21:58:51.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1544 2024-09-14T21:58:51.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:51.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:52.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1547 2024-09-14T21:58:52.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1546 2024-09-14T21:58:52.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:52.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:52.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:52.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:53.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1548 2024-09-14T21:58:53.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1549 2024-09-14T21:58:53.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:53.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:53.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:53.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:53.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1550 2024-09-14T21:58:53.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1551 2024-09-14T21:58:53.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:53.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1552 2024-09-14T21:58:54.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1553 2024-09-14T21:58:54.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:54.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:55.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:55.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:55.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:55.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:55.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:55.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:55.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1554 2024-09-14T21:58:55.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1555 2024-09-14T21:58:55.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:55.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:55.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:55.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:55.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:55.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:55.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:55.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:56.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1557 2024-09-14T21:58:56.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1556 2024-09-14T21:58:56.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:56.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:58:56.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:56.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:56.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:58:56.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:58:56.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:56.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:56.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:58:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:58:56.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:58:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:58:56.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:58:57.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1558 2024-09-14T21:58:57.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1559 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:58:57.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:58:57.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:57.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:58:57.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:57.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:57.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:58:57.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:58:57.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:58:58.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:58:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:58:58.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:58:59.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1561 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:58:59.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:58:59.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1560 2024-09-14T21:58:59.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:58:59.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:58:59.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:58:59.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:58:59.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:58:59.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:58:59.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:58:59.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:00.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1562 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:00.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1563 2024-09-14T21:59:00.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:00.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:00.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:00.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:00.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:00.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:00.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:00.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:01.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1565 2024-09-14T21:59:01.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1564 2024-09-14T21:59:01.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:01.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:02.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1567 2024-09-14T21:59:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1566 2024-09-14T21:59:02.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:02.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:02.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:02.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:02.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:02.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:02.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:02.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:02.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:03.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1568 2024-09-14T21:59:03.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1569 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:03.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:03.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:03.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:03.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:03.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1570 2024-09-14T21:59:03.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1571 2024-09-14T21:59:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:04.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1572 2024-09-14T21:59:04.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1573 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:04.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:04.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:04.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:04.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:04.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:04.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:04.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:04.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:05.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:05.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1575 2024-09-14T21:59:05.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1574 2024-09-14T21:59:05.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:05.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:06.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1577 2024-09-14T21:59:06.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1576 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:06.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:06.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:06.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:06.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:06.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:06.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:06.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:06.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:06.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:06.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:07.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1578 2024-09-14T21:59:07.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1579 2024-09-14T21:59:07.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:07.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:07.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:07.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:08.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:08.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:09.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1580 2024-09-14T21:59:09.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1581 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:09.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:09.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:09.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:09.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:10.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:10.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:10.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:10.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:10.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:10.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:10.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:10.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1583 2024-09-14T21:59:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1582 2024-09-14T21:59:10.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:10.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:11.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1585 2024-09-14T21:59:11.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1584 2024-09-14T21:59:11.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:11.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:12.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1586 2024-09-14T21:59:12.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1587 2024-09-14T21:59:12.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:12.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:12.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:13.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1589 2024-09-14T21:59:13.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1588 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:13.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:13.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:13.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:13.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:13.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:13.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:13.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:13.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:13.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1590 2024-09-14T21:59:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1591 2024-09-14T21:59:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:13.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:14.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1593 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:14.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:14.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1592 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:15.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:15.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:15.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:15.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:15.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:15.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:15.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:15.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1594 2024-09-14T21:59:15.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1595 2024-09-14T21:59:15.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:15.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:16.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1596 2024-09-14T21:59:16.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1597 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:16.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:16.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:16.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:16.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:16.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:16.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:16.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:16.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:16.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:16.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:16.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:16.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:17.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1598 2024-09-14T21:59:17.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:17.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1599 2024-09-14T21:59:17.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:17.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:17.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:17.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:18.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:18.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:18.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:18.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:18.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:18.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:18.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:19.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1601 2024-09-14T21:59:19.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1600 2024-09-14T21:59:19.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:19.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1602 2024-09-14T21:59:20.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1603 2024-09-14T21:59:20.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:20.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:20.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:20.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:20.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:20.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:20.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:20.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:20.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:20.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:20.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:20.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:20.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:20.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:21.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1604 2024-09-14T21:59:21.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1605 2024-09-14T21:59:21.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:21.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:22.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1607 2024-09-14T21:59:22.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1606 2024-09-14T21:59:22.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:22.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:22.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:22.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:22.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1608 2024-09-14T21:59:23.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1609 2024-09-14T21:59:23.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:23.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:23.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:23.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:23.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:23.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:23.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:23.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:23.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:23.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:23.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:23.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:23.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:23.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:23.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1611 2024-09-14T21:59:23.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1610 2024-09-14T21:59:23.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:23.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:24.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1613 2024-09-14T21:59:24.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1612 2024-09-14T21:59:24.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:24.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:24.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:24.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:24.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:24.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:24.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:24.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:24.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:24.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:24.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:24.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:24.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:24.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:25.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1615 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:25.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:25.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1614 2024-09-14T21:59:25.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:25.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:25.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:26.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1616 2024-09-14T21:59:26.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1617 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:26.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T21:59:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:26.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T21:59:26.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T21:59:26.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:26.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:26.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T21:59:26.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:26.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:26.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T21:59:26.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T21:59:27.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1619 2024-09-14T21:59:27.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1618 2024-09-14T21:59:27.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:27.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:27.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:27.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:27.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:27.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:27.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T21:59:27.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:28.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:28.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:28.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:28.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:28.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:28.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T21:59:28.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T21:59:29.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1620 2024-09-14T21:59:29.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1621 2024-09-14T21:59:29.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:29.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:29.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:29.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:29.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:29.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T21:59:29.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T21:59:29.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:29.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:30.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1622 2024-09-14T21:59:30.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1623 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T21:59:30.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T21:59:30.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:30.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83305 2024-09-14T21:59:30.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:30.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:31.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1625 2024-09-14T21:59:31.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1624 2024-09-14T21:59:31.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:31.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:32.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1627 2024-09-14T21:59:32.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1626 2024-09-14T21:59:32.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:32.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:32.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:32.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83437 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T21:59:32.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T21:59:33.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1628 2024-09-14T21:59:33.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:33.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1629 2024-09-14T21:59:33.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83569 2024-09-14T21:59:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T21:59:33.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:33.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:33.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T21:59:33.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T21:59:33.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:34.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1630 2024-09-14T21:59:34.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T21:59:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:34.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T21:59:34.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T21:59:34.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:34.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83721 2024-09-14T21:59:35.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T21:59:35.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T21:59:35.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T21:59:35.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T21:59:35.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T21:59:35.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T21:59:35.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:35.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83874 2024-09-14T21:59:35.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1631 2024-09-14T21:59:35.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:36.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84027 2024-09-14T21:59:36.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1632 2024-09-14T21:59:36.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T21:59:36.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:36.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84180 2024-09-14T21:59:37.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:37.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84353 2024-09-14T21:59:38.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T21:59:38.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84527 2024-09-14T21:59:39.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T21:59:39.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T21:59:39.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83174 2024-09-14T22:02:06.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:06.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:06.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:06.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83306 2024-09-14T22:02:07.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:07.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:07.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:07.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83438 2024-09-14T22:02:08.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:08.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:08.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:08.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83570 2024-09-14T22:02:09.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:09.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:09.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:09.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83722 2024-09-14T22:02:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 83875 2024-09-14T22:02:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:11.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:11.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84028 2024-09-14T22:02:12.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:12.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:12.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:12.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84181 2024-09-14T22:02:13.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:13.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84354 2024-09-14T22:02:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:02:14.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 84528 2024-09-14T22:02:15.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:02:15.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:02:15.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:02:15.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:02:15.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:02:15.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:02:15.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:02:15.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:02:15.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:02:15.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:02:15.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:02:15.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:02:15.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:02:15.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:02:15.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:02:15.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:02:15.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90505 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:02:15.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:02:15.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:02:16.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:02:16.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:02:16.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:02:16.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:02:16.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:02:16.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:02:16.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:02:16.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:02:16.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:02:16.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:02:16.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:03:09.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=2d76d0f3c4325202dd250b07913d71a3 2024-09-14T22:03:09.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:03:09.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=b2f58d4256ee6622f1bc75c359c2f020 2024-09-14T22:03:09.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:03:09.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:03:09.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:09.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:09.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:09.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:03:10.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:03:10.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:10.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:10.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:10.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:03:11.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0bcc55cb45d4e80102ae96a518ff53e3 2024-09-14T22:03:11.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:03:11.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=b7bcfbba63ed9ec3035931e9899e5cb7 2024-09-14T22:03:11.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:03:11.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:03:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:11.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:03:11.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:03:11.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:11.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:11.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:11.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:03:11.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:11.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:11.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:11.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:11.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:11.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=787ee50c01785b7afc6e452123ab81a1 2024-09-14T22:03:11.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:03:11.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:03:11.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:11.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:11.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:11.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:03:12.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=27da574ffd1118fdb1db2e51f3a05cab 2024-09-14T22:03:12.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:03:12.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a3d385edf7be5dea3a2342e86ab2ff4a 2024-09-14T22:03:12.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:03:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:03:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:03:12.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:03:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:12.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:03:12.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=1e2fd11b4cf55230abd31d2425c4d755 2024-09-14T22:03:12.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:03:12.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:12.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:12.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:12.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:12.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:03:12.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:12.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:12.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:12.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:12.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:12.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:12.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:03:12.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:12.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:03:12.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:03:12.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:12.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:12.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:12.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:12.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:12.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:12.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=cdc7de17814c97c050c373657d86d35d 2024-09-14T22:03:12.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:03:12.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=17df92cb21977e1d76120438ae094822 2024-09-14T22:03:12.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:03:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:03:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:03:12.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:03:12.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:12.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:12.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:12.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:13.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:03:13.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:13.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:13.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:03:13.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:13.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:13.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:03:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:13.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:13.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:03:13.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:13.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:03:13.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:13.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:13.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:13.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:13.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:13.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:13.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:13.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:13.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:13.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:13.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:13.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:13.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:13.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:13.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:13.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:13.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:13.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:14.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:14.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:03:14.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:14.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:03:14.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:14.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:03:14.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:14.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:14.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:14.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:14.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:14.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:14.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:14.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:14.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:14.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:14.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:14.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:14.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:14.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:14.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:14.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:14.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:03:15.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:15.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:15.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:15.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:15.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:15.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:15.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:15.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:15.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:15.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:15.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:15.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:15.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:15.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:03:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:15.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:03:15.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:15.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:15.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:15.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:15.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:15.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:15.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:16.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:16.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:16.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:03:16.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:16.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:16.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:16.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:16.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:16.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:16.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:16.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:16.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:16.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:16.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:16.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:16.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:16.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:16.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:16.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:16.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:16.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:16.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:16.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:16.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:16.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:17.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:17.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:17.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:17.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:17.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:03:17.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:17.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:17.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:17.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:17.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:18.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:18.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:18.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:18.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:18.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:18.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:18.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:18.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:18.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:18.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:18.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:18.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:18.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:18.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:18.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:19.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:03:19.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:19.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:19.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:19.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:19.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:19.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:19.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:19.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:20.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:20.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:20.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:20.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:20.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:20.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:20.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:20.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:20.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:20.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:20.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:20.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:20.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:20.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:20.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:20.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:03:20.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:20.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:20.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:20.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:20.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:20.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:20.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:20.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:21.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:21.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:21.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:21.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:21.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:21.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:21.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:21.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:21.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:21.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:21.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:21.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:21.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:21.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:21.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:21.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:21.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:21.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:03:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:26.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:26.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:26.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:03:27.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:27.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:27.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:27.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:27.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:27.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:27.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:27.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:27.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:27.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:27.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:27.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:27.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:27.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:28.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:28.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:28.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:28.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:28.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:28.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:03:28.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:28.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:28.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:28.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:28.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:28.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:28.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:28.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:28.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:28.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:28.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:28.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:28.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:28.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:28.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:28.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:29.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:29.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:29.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:29.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:03:29.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:29.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:03:29.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:29.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:03:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:29.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:29.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:29.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:29.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:29.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:29.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:29.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:29.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:29.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:29.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:29.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:29.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:29.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:29.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:29.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:29.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:29.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:29.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:29.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:01' 2024-09-14T22:03:30.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:30.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:03:30.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:30.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:03:35.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:35.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:35.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:03:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:03:35.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:35.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:35.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:35.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:35.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:35.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:35.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:35.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:35.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:35.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:35.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:35.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:35.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:35.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:35.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:35.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:35.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:35.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:35.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:35.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:35.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:35.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:35.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:35.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:35.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:35.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:35.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:35.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:35.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:35.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:03:35.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:35.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:35.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:03:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:03:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:03:35.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:35.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:35.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:35.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:35.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:35.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:35.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:35.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:35.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:35.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:35.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:03:35.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:03:36.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:36.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:03:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:36.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:36.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:36.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:36.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:36.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:36.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:36.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:36.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:36.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:36.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:36.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:36.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:36.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:36.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:36.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:36.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:36.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:36.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:36.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:36.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:36.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:36.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:36.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:36.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:36.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:36.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:36.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:03:36.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:03:36.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:03:36.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:36.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:36.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:03:36.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:03:36.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:36.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:36.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:36.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:36.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:36.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:36.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:03:36.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:36.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:36.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:03:36.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:03:36.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:03:36.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:36.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:36.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:36.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:36.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:36.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:36.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:36.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:36.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:36.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:36.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:36.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:36.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:36.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:36.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:36.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:36.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:36.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:36.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:03:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:03:36.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:36.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:03:36.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:03:36.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:36.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:36.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:03:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:36.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:03:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:36.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:36.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:36.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:03:36.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:36.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:36.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:03:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:03:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:03:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:03:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:36.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:03:36.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:03:37.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:03:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:03:37.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:37.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:37.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:03:37.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:03:37.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:03:37.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:03:37.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:37.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:37.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:03:37.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:03:37.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:03:37.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:03:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:03:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:37.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:37.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:37.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:03:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:03:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:03:37.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:03:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:37.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:37.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:37.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:37.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:37.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:37.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:37.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:37.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:37.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:37.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:03:37.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:03:37.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:37.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:03:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:03:37.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:37.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:37.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:03:37.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:03:37.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:37.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:03:37.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:03:37.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:37.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:03:37.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:37.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:37.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:03:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:03:38.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:38.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:38.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:38.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:38.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:38.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:38.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:38.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:38.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:38.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:38.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:38.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:38.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:38.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:38.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:03:38.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:03:38.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:38.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:38.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:03:38.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:03:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:03:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:03:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:38.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:38.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:03:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:03:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:03:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:38.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:38.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:38.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:38.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:38.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:38.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:38.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:38.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:38.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:38.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:38.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:38.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:03:38.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:03:38.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:38.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:38.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:38.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:38.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:38.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:38.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:38.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:38.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:38.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:38.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:38.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:38.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:38.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:38.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:38.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:38.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:38.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:38.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:38.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:38.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:38.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:38.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:38.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:38.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:38.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:38.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:38.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:38.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:38.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:38.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:03:38.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:38.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:38.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:03:38.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:38.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:38.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:38.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:03:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:03:38.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:38.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:03:38.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:03:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:38.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:03:38.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:03:38.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:38.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:03:38.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:38.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:38.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:03:38.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:03:38.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:38.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:03:38.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:38.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:38.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:38.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:38.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:38.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:03:38.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:03:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:38.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:03:38.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:38.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:03:39.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:39.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:39.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:03:39.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:39.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:03:39.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:39.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:39.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:39.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:03:39.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:39.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:03:39.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:03:39.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:03:39.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:39.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:03:39.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:03:39.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:39.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:03:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:03:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:03:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:39.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:03:39.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:03:39.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:39.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:39.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:03:31' 2024-09-14T22:03:39.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:03:39.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:03:39.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:03:39.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:03:39.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:03:39.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:39.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:03:39.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:39.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:03:39.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:03:39.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:03:39.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:03:31' 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:39.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:03:39.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:03:31' 2024-09-14T22:03:39.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:03:39.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:03:39.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:03:39.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:03:31' 2024-09-14T22:03:39.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:03:39.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:03:39.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:03:31' 2024-09-14T22:03:39.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:03:39.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:03:39.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:03:39.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:03:39.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:03:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:03:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:03:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:03:39.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:03:39.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:03:39.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:03:39.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:03:39.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:39.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:39.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:39.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:39.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:03:39.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:39.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:39.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:03:39.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:39.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:39.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:39.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:39.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:03:39.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:03:39.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:39.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:39.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:03:39.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:03:39.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:03:39.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:03:40.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:03:40.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:03:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:03:40.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:03:40.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:03:40.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:03:40.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:40.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:40.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:03:40.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:03:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:03:40.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:03:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:03:40.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:04:27.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=2d76d0f3c4325202dd250b07913d71a3 2024-09-14T22:04:27.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:04:27.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=b2f58d4256ee6622f1bc75c359c2f020 2024-09-14T22:04:27.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:04:28.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 2d76d0f3c4325202dd250b07913d71a3 != \2\d\7\6\d\0\f\3\c\4\3\2\5\2\0\2\d\d\2\5\0\b\0\7\9\1\3\d\7\1\a\3 ]] 2024-09-14T22:04:28.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ b2f58d4256ee6622f1bc75c359c2f020 != \b\2\f\5\8\d\4\2\5\6\e\e\6\6\2\2\f\1\b\c\7\5\c\3\5\9\c\2\f\0\2\0 ]] 2024-09-14T22:04:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=1e2fd11b4cf55230abd31d2425c4d755 2024-09-14T22:04:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:04:33.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 1e2fd11b4cf55230abd31d2425c4d755 != \1\e\2\f\d\1\1\b\4\c\f\5\5\2\3\0\a\b\d\3\1\d\2\4\2\5\c\4\d\7\5\5 ]] 2024-09-14T22:04:33.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=787ee50c01785b7afc6e452123ab81a1 2024-09-14T22:04:33.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:04:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=b7bcfbba63ed9ec3035931e9899e5cb7 2024-09-14T22:04:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:04:33.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 787ee50c01785b7afc6e452123ab81a1 != \7\8\7\e\e\5\0\c\0\1\7\8\5\b\7\a\f\c\6\e\4\5\2\1\2\3\a\b\8\1\a\1 ]] 2024-09-14T22:04:33.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ b7bcfbba63ed9ec3035931e9899e5cb7 != \b\7\b\c\f\b\b\a\6\3\e\d\9\e\c\3\0\3\5\9\3\1\e\9\8\9\9\e\5\c\b\7 ]] 2024-09-14T22:04:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a3d385edf7be5dea3a2342e86ab2ff4a 2024-09-14T22:04:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:04:34.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a3d385edf7be5dea3a2342e86ab2ff4a != \a\3\d\3\8\5\e\d\f\7\b\e\5\d\e\a\3\a\2\3\4\2\e\8\6\a\b\2\f\f\4\a ]] 2024-09-14T22:04:34.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=27da574ffd1118fdb1db2e51f3a05cab 2024-09-14T22:04:34.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:04:34.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=17df92cb21977e1d76120438ae094822 2024-09-14T22:04:34.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:04:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 27da574ffd1118fdb1db2e51f3a05cab != \2\7\d\a\5\7\4\f\f\d\1\1\1\8\f\d\b\1\d\b\2\e\5\1\f\3\a\0\5\c\a\b ]] 2024-09-14T22:04:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90506 2024-09-14T22:04:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90508 2024-09-14T22:04:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90510 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 17df92cb21977e1d76120438ae094822 != \1\7\d\f\9\2\c\b\2\1\9\7\7\e\1\d\7\6\1\2\0\4\3\8\a\e\0\9\4\8\2\2 ]] 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90512 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90514 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:34.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90516 2024-09-14T22:04:34.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=cdc7de17814c97c050c373657d86d35d 2024-09-14T22:04:34.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:04:35.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ cdc7de17814c97c050c373657d86d35d != \c\d\c\7\d\e\1\7\8\1\4\c\9\7\c\0\5\0\c\3\7\3\6\5\7\d\8\6\d\3\5\d ]] 2024-09-14T22:04:35.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0bcc55cb45d4e80102ae96a518ff53e3 2024-09-14T22:04:35.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:04:35.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0bcc55cb45d4e80102ae96a518ff53e3 != \0\b\c\c\5\5\c\b\4\5\d\4\e\8\0\1\0\2\a\e\9\6\a\5\1\8\f\f\5\3\e\3 ]] 2024-09-14T22:04:35.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:35.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90518 2024-09-14T22:04:35.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:35.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90520 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 90521 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:35.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5c5610f0-327e-4cd1-853e-d142dbfdd425 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3332096.0,"bytes_per_snapshot":66641920.0,"last_snapshot_bytes":66641920,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:36.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:36.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:36.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3332096.0,"bytes_per_snapshot":66641920.0,"last_snapshot_bytes":66641920,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:36.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:36.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:36.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:36.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:36.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:36.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:36.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:36.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:36.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:36.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:36.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:36.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary15c5610f0-327e-4cd1-853e-d142dbfdd425up+replayingreplaying, {"bytes_per_second":3332096.0,"bytes_per_snapshot":66641920.0,"last_snapshot_bytes":66641920,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+replayingreplaying, {"bytes_per_second":3211878.4,"bytes_per_snapshot":64237568.0,"last_snapshot_bytes":64237568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+replayingreplaying, {"bytes_per_second":3124428.8,"bytes_per_snapshot":62488576.0,"last_snapshot_bytes":62488576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+replayingreplaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+replayingreplaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:36.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:36.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:04:36.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:36.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:04:36.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:36.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:36.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:36.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:04:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:04:36.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:36.988+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed5ba0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:36.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:36.988+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/5c5610f0-327e-4cd1-853e-d142dbfdd425] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:39.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:39.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:04:39.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:39.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:04:39.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:39.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:39.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:40.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:40.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:40.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:04:40.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:04:40.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 927d9611-efd5-4261-8d61-04fa16123db5 2024-09-14T22:04:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3211878.4,"bytes_per_snapshot":64237568.0,"last_snapshot_bytes":64237568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:40.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:40.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:40.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:40.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3211878.4,"bytes_per_snapshot":64237568.0,"last_snapshot_bytes":64237568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:40.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:40.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:40.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:40.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:40.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:40.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:40.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:40.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:40.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary2927d9611-efd5-4261-8d61-04fa16123db5up+replayingreplaying, {"bytes_per_second":3211878.4,"bytes_per_snapshot":64237568.0,"last_snapshot_bytes":64237568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+replayingreplaying, {"bytes_per_second":3124428.8,"bytes_per_snapshot":62488576.0,"last_snapshot_bytes":62488576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+replayingreplaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+replayingreplaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:40.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:40.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:04:40.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:04:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:40.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:40.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:40.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:40.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:40.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:04:40.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:40.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:40.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:40.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:04:40.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:04:40.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:40.565+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed4000 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:40.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:40.565+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/927d9611-efd5-4261-8d61-04fa16123db5] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:42.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:04:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:04:42.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:42.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:42.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:04:42.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:42.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:04:42.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:42.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:04:42.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:04:42.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:42.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:42.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:42.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:42.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:42.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:42.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:42.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:43.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:43.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:43.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:43.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:04:43.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:04:43.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7610d6a3-3253-4251-891e-ee3e6a8f2091 2024-09-14T22:04:43.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:43.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3124428.8,"bytes_per_snapshot":62488576.0,"last_snapshot_bytes":62488576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:43.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:43.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:43.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:43.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:43.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:43.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3124428.8,"bytes_per_snapshot":62488576.0,"last_snapshot_bytes":62488576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:43.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:43.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:43.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:43.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:43.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:43.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:43.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:43.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:43.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:43.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:43.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:43.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:43.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary37610d6a3-3253-4251-891e-ee3e6a8f2091up+replayingreplaying, {"bytes_per_second":3124428.8,"bytes_per_snapshot":62488576.0,"last_snapshot_bytes":62488576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+replayingreplaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+replayingreplaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:43.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:43.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:04:43.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:43.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:04:43.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:43.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:43.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:43.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:43.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:04:43.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:43.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:43.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:04:43.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:04:43.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:43.612+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a964680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:43.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:43.612+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/7610d6a3-3253-4251-891e-ee3e6a8f2091] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:45.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:45.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:45.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:04:45.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:45.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:04:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:04:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:04:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:45.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:45.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:45.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:45.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:46.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:04:46.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:46.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 80914702-475f-4897-ab7e-6ae080461c6e 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:46.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:46.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:46.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:46.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:46.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:46.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:46.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:46.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:46.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:46.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:46.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:46.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:46.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:46.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary480914702-475f-4897-ab7e-6ae080461c6eup+replayingreplaying, {"bytes_per_second":3129958.4,"bytes_per_snapshot":62599168.0,"last_snapshot_bytes":62599168,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+replayingreplaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:46.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:04:46.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:46.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:04:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:46.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:46.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:46.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:46.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:04:46.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:04:46.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:46.564+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a80f860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:46.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:46.564+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/80914702-475f-4897-ab7e-6ae080461c6e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:47.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:47.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:04:47.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:47.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:47.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:04:47.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:47.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:47.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:04:47.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:47.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:04:47.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:47.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:04:47.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:04:47.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:47.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:47.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:48.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:04:48.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:48.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 528dd914-84fc-437b-89bf-2740d7206501 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:49.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:49.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:49.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:49.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:49.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:49.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:49.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:49.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:49.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:49.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:49.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:49.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:49.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:49.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:49.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary5528dd914-84fc-437b-89bf-2740d7206501up+replayingreplaying, {"bytes_per_second":3422412.8,"bytes_per_snapshot":68448256.0,"last_snapshot_bytes":68448256,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:04:49.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:49.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:04:49.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:49.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:49.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:49.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:49.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:49.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:49.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:04:49.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:49.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:49.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:49.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:04:49.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:04:49.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:49.393+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7ed6c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:49.397 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:49.393+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/528dd914-84fc-437b-89bf-2740d7206501] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:51.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:51.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:04:51.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:51.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:51.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:04:51.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:51.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:51.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:04:51.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:51.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:04:51.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:51.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:51.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:04:51.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:51.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:51.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:51.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:51.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:51.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:51.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:51.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:52.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:04:52.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:52.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:52.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:52.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:52.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:52.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:52.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:52.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:52.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:04:52.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 3d9b6349-5c80-463f-8349-1eb991adf41c 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:52.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:52.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:52.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"} 2024-09-14T22:04:52.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:52.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:52.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:52.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:52.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:52.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:52.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary63d9b6349-5c80-463f-8349-1eb991adf41cup+replayingreplaying, {"bytes_per_second":3115008.0,"bytes_per_snapshot":62300160.0,"last_snapshot_bytes":62300160,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351418,"remote_snapshot_timestamp":1726351418,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:04:52.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:52.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:04:52.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:52.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:52.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:52.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:52.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:52.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:52.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:04:52.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:52.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:52.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:52.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:04:52.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:04:52.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:52.764+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7ecea0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:52.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:52.765+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/3d9b6349-5c80-463f-8349-1eb991adf41c] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:53.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:53.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:53.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:04:53.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:53.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:04:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:04:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:04:53.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:54.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:54.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:04:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:04:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4c032aec-4f68-40d5-b664-e1168a62ff00 2024-09-14T22:04:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:55.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:55.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:55.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:55.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:55.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:55.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:55.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:55.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:55.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:55.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:55.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:55.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary74c032aec-4f68-40d5-b664-e1168a62ff00up+replayingreplaying, {"bytes_per_second":3318374.4,"bytes_per_snapshot":66367488.0,"last_snapshot_bytes":66367488,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:55.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:55.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:04:55.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:55.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:04:55.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:55.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:55.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:55.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:55.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:55.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:04:55.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:04:55.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:55.382+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589cc2680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:55.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:55.383+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/4c032aec-4f68-40d5-b664-e1168a62ff00] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:56.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:04:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:56.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:04:56.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:56.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:56.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:04:56.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:56.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:04:56.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:56.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:56.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:56.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:04:57.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:57.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:57.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:04:58.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d0f328df-a75f-4ecf-ade2-d585cf16b1c0 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:04:58.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:04:58.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:04:58.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:04:58.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"} 2024-09-14T22:04:58.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:04:58.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:58.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:04:58.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:58.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:04:58.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:04:58.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:04:58.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:04:58.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:04:58.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:04:58.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:04:58.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":3405824.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary8d0f328df-a75f-4ecf-ade2-d585cf16b1c0up+replayingreplaying, {"bytes_per_second":3410739.2,"bytes_per_snapshot":68214784.0,"last_snapshot_bytes":68214784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351419,"remote_snapshot_timestamp":1726351419,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:04:31' 2024-09-14T22:04:58.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:04:58.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:04:58.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:04:58.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:04:58.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:04:58.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:04:58.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:04:58.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:04:58.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:58.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:58.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:04:58.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:04:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:04:58.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:04:58.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:58.406+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a404680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:04:58.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:04:58.406+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/d0f328df-a75f-4ecf-ade2-d585cf16b1c0] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:04:59.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:04:59.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:04:59.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:59.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:59.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:04:59.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:04:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:04:59.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:04:59.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:04:59.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:04:59.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:05:00.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:05:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:05:01.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 94f21b3a-5ef4-4aac-a40c-dbe16fa436ce 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"} 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:04:31' 2024-09-14T22:05:01.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:05:01.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:05:01.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:05:01.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3333939.2,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"} 2024-09-14T22:05:01.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:05:01.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:05:01.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:05:01.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:05:01.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:05:01.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:05:01.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:05:01.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:04:31' 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:04:31' 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:04:31' 2024-09-14T22:05:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:05:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:05:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:05:01.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:05:01image-primary994f21b3a-5ef4-4aac-a40c-dbe16fa436ceup+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66678784.0,"last_snapshot_bytes":66678784,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:05:01' 2024-09-14T22:05:01.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:05:01.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:05:01.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:05:01' 2024-09-14T22:05:01.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:05:01.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:05:01.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:05:01.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:05:01.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:01.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:05:01.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:05:01.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:05:01.548+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7edba0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:05:01.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:05:01.548+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/94f21b3a-5ef4-4aac-a40c-dbe16fa436ce] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:05:02.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:05:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:05:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:05:02.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:05:02.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:05:02.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:02.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:05:02.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:02.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:05:02.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:05:02.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:05:02.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:05:03.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:05:03.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:05:03.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:05:04.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 34c7b58f-eac4-423d-8ca0-02b9937ac2dd 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"} 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:05:01' 2024-09-14T22:05:04.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:05:04.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:05:04.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:05:04.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"} 2024-09-14T22:05:04.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:05:04.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:05:04.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:05:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:05:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:05:04.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:05:04.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:05:04.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:05:01' 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:05:01' 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:05:01' 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:05:04.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:05:04.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:05:04.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1034c7b58f-eac4-423d-8ca0-02b9937ac2ddup+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":68116480.0,"last_snapshot_bytes":68116480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351416,"remote_snapshot_timestamp":1726351416,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:05:01' 2024-09-14T22:05:04.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:05:04.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:05:04.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:05:01' 2024-09-14T22:05:04.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:05:04.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:05:04.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:05:04.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:05:04.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:04.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:05:04.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:05:04.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:05:04.351+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5886aa9c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:05:04.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:05:04.351+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4f00 [3/34c7b58f-eac4-423d-8ca0-02b9937ac2dd] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:05:05.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:05:05.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:05:05.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:05.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:05.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:05.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:05:05.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:05:05.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:05:06.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:06.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T22:05:06.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:06.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T22:05:06.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:06.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T22:05:06.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:06.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 29029eade489 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.29029eade489 2024-09-14T22:05:06.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:06 2024 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:06 2024 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:06 2024 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:05:06.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:06.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:06.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:06.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T22:05:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T22:05:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T22:05:07.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:07.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:07.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 2b7f2d4e-9ce8-4329-88dd-152a2f15277e 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:07.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:07.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:07.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:07.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:07.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T22:05:07.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T22:05:07.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:07.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:07.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:07.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T22:05:07.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:07.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:07.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:07.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:07.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T22:05:07.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:07.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T22:05:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1654 2024-09-14T22:05:07.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:07.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:07.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T22:05:07.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T22:05:07.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 29115f2df51c 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.29115f2df51c 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:07 2024 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:07 2024 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:07 2024 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:07.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:07.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:05:07.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:07.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:07.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:07.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T22:05:07.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T22:05:07.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:07.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T22:05:07.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: f9ad026c-d876-4541-b1d1-fb91ad6e28fc 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:07.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:07.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:07.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T22:05:07.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T22:05:08.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:08.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:08.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:08.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:08.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T22:05:08.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:08.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T22:05:08.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1656 2024-09-14T22:05:08.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:08.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:08.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T22:05:08.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T22:05:08.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 29206be78c67 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.29206be78c67 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:08 2024 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:08 2024 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:08 2024 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:08.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:05:08.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:08.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:08.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:08.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T22:05:08.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T22:05:08.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:08.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T22:05:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: dd9887dc-370a-4191-a934-a43494eb13c4 2024-09-14T22:05:08.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:08.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:08.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:08.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:08.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:08.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:08.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:08.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:08.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T22:05:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T22:05:09.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:09.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:05:09.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:09.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:09.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T22:05:09.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:09.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:09.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:09.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T22:05:09.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:09.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:09.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:09.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T22:05:09.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:09.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T22:05:09.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:09.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1658 2024-09-14T22:05:09.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:09.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T22:05:09.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T22:05:09.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:09.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:09.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:09.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 292e85c9caa4 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.292e85c9caa4 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:09 2024 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:09 2024 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:09 2024 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:05:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:09.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:09.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:09.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T22:05:09.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T22:05:09.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:09.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T22:05:09.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 78685392-eb10-4829-95cb-764112305b7d 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:09.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:09.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:10.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:10.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:10.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T22:05:10.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T22:05:10.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:10.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:10.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:10.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:10.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:10.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:10.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T22:05:10.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T22:05:10.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T22:05:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:10.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T22:05:10.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:10.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:10.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T22:05:10.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:10.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T22:05:10.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:10.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:10.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:10.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:10.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:10.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:10.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:10.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1660 2024-09-14T22:05:10.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T22:05:10.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 293db2c485ba 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.293db2c485ba 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:10.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:10 2024 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:10 2024 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:10 2024 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:05:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T22:05:11.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T22:05:11.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:11.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T22:05:11.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:11.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:11.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:11.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 4bd4550d-5c6e-4bcf-a332-a91466057c49 2024-09-14T22:05:11.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:11.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:11.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:11.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:11.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:11.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:11.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:11.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:11.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T22:05:11.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T22:05:11.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:11.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T22:05:11.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:11.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:11.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:11.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T22:05:11.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:11.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T22:05:11.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:11.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:11.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:11.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:11.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T22:05:11.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1662 2024-09-14T22:05:11.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:11.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1663 2024-09-14T22:05:11.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:11.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:11.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T22:05:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T22:05:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 294ef738747b 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.294ef738747b 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:11 2024 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:11 2024 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:11 2024 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:05:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:11.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:11.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:11.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T22:05:12.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T22:05:12.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:12.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T22:05:12.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 4be62c43-6823-4c67-a345-485d9b6a3d34 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:12.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:12.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:12.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:12.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:12.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:12.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:12.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T22:05:12.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T22:05:12.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:12.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T22:05:12.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:12.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T22:05:12.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T22:05:12.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T22:05:12.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:12.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:12.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:12.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T22:05:12.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1666 2024-09-14T22:05:12.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1665 2024-09-14T22:05:12.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:12.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:12.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:12.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:12.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:12.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:12.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:12.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:12.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:12.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T22:05:13.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:13.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1668 2024-09-14T22:05:13.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T22:05:13.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 295ef08557f8 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.295ef08557f8 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:12 2024 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:12 2024 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:12 2024 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:05:13.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:13.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:13.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:13.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T22:05:13.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:13.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:13.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:13.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:13.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:13.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:13.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T22:05:13.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:13.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T22:05:13.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:14.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/26214402097152/2621440 done 2024-09-14T22:05:14.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:14.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 39db188b-be4b-4f33-afcc-5ee094e46d60 2024-09-14T22:05:14.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:14.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:14.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:14.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:14.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:14.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:14.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:14.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:14.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T22:05:14.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T22:05:14.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T22:05:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T22:05:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:14.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:14.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:14.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T22:05:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T22:05:14.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1669 2024-09-14T22:05:14.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:14.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1670 2024-09-14T22:05:14.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:14.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:14.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T22:05:14.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T22:05:14.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:14.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 29721b284192 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.29721b284192 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:14 2024 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:14 2024 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:14 2024 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:14.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:14.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:05:14.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:14.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T22:05:14.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:14.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T22:05:14.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:14.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T22:05:14.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:14.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:14.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:14.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 7499de90-fab0-45cc-8a31-bae1b186fa4b 2024-09-14T22:05:14.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:14.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:14.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:14.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:14.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:14.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:15.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:15.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:15.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T22:05:15.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T22:05:15.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:15.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T22:05:15.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T22:05:15.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:15.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:15.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:15.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:15.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1672 2024-09-14T22:05:15.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1674 2024-09-14T22:05:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1673 2024-09-14T22:05:15.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:15.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T22:05:15.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:15.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:15.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T22:05:15.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:15.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 298697a150b1 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.298697a150b1 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:15 2024 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:15 2024 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:15 2024 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:05:15.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:15.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:15.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:15.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T22:05:16.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T22:05:16.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:16.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T22:05:16.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: d72f54fa-abcd-4497-97d0-92364d5da7e4 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:16.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:16.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:16.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T22:05:16.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T22:05:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:16.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T22:05:16.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:05:16.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T22:05:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:05:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T22:05:16.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:16.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:05:16.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T22:05:16.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1676 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:16.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:16.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1678 2024-09-14T22:05:16.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1677 2024-09-14T22:05:16.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:16.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T22:05:17.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:17.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:17.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1680 2024-09-14T22:05:17.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:17.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2999b539a024 2024-09-14T22:05:17.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2999b539a024 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:05:16 2024 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:05:16 2024 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:05:16 2024 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:05:17.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:05:17.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:05:17.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:05:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:05:17.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T22:05:18.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T22:05:18.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:05:18.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T22:05:18.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: f582d9ad-9f5c-43c5-9fbb-188ba152fde2 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:05:18.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:05:18.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:05:18.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:05:18.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:05:18.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T22:05:18.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T22:05:18.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:05:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T22:05:18.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:05:18.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T22:05:18.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95158 2024-09-14T22:05:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T22:05:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T22:05:18.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:05:18.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T22:05:18.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:18.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:18.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:18.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:18.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:18.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:18.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:18.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:18.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:18.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1682 2024-09-14T22:05:18.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1683 2024-09-14T22:05:18.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1681 2024-09-14T22:05:18.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:18.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:18.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:19.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:19.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:19.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:19.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:19.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:19.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:19.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:19.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:19.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:19.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:19.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:19.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:19.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1686 2024-09-14T22:05:19.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1685 2024-09-14T22:05:19.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1684 2024-09-14T22:05:19.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:19.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:19.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:20.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:20.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1689 2024-09-14T22:05:20.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1688 2024-09-14T22:05:20.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:20.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1687 2024-09-14T22:05:20.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:20.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:21.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1690 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:21.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:21.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:21.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:21.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:22.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1692 2024-09-14T22:05:22.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1693 2024-09-14T22:05:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1691 2024-09-14T22:05:22.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:22.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:22.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:22.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:22.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:22.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:22.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:22.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:22.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:22.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:23.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1694 2024-09-14T22:05:23.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1696 2024-09-14T22:05:23.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1695 2024-09-14T22:05:23.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:23.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:23.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:23.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:23.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:23.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:23.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:23.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:24.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1698 2024-09-14T22:05:24.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1697 2024-09-14T22:05:24.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1699 2024-09-14T22:05:24.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:24.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:24.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:24.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:25.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:25.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:25.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:25.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:25.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:25.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1700 2024-09-14T22:05:25.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:26.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1703 2024-09-14T22:05:26.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1701 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:26.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:26.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:26.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:26.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1702 2024-09-14T22:05:26.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:26.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:27.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1705 2024-09-14T22:05:27.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:27.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1704 2024-09-14T22:05:27.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:27.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:27.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:27.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:27.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:27.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:27.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:27.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:27.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:28.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:28.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1708 2024-09-14T22:05:28.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1707 2024-09-14T22:05:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:28.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:29.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1706 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:29.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:29.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:29.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:29.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:29.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:29.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:29.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:29.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:29.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:30.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:30.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:30.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:30.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:30.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:30.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:30.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:30.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:30.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:30.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:30.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:30.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:30.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1709 2024-09-14T22:05:30.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:30.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1713 2024-09-14T22:05:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1711 2024-09-14T22:05:30.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:30.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:31.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1710 2024-09-14T22:05:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:31.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1714 2024-09-14T22:05:31.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:31.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:31.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:31.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:31.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:31.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:31.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:31.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:32.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1712 2024-09-14T22:05:32.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:32.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1716 2024-09-14T22:05:32.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:32.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:33.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1715 2024-09-14T22:05:33.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:33.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:33.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1718 2024-09-14T22:05:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:34.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1717 2024-09-14T22:05:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:34.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:34.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:34.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:34.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:34.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:34.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:34.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1719 2024-09-14T22:05:34.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1720 2024-09-14T22:05:34.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:34.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:35.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:35.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1722 2024-09-14T22:05:35.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:36.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:36.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:36.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:36.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:36.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:36.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:36.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1721 2024-09-14T22:05:36.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:36.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:36.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:36.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:36.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:36.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:36.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:36.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1724 2024-09-14T22:05:36.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:37.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1723 2024-09-14T22:05:37.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1727 2024-09-14T22:05:37.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:37.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:37.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:37.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:37.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:37.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:37.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:37.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:37.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:37.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:37.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:37.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:37.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1725 2024-09-14T22:05:38.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:38.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1729 2024-09-14T22:05:38.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:38.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:38.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:38.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:38.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:38.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:38.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:39.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1726 2024-09-14T22:05:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:39.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:39.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:40.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:40.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:40.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:40.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:40.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:40.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:40.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1728 2024-09-14T22:05:40.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1730 2024-09-14T22:05:40.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:40.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:40.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:40.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1732 2024-09-14T22:05:40.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:41.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:41.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:41.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1731 2024-09-14T22:05:41.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:41.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:41.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:41.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:41.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:41.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:41.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:41.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1734 2024-09-14T22:05:41.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1733 2024-09-14T22:05:42.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:42.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1736 2024-09-14T22:05:42.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:42.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:42.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:42.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:42.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:42.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:42.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:43.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1735 2024-09-14T22:05:43.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:43.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1738 2024-09-14T22:05:43.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:43.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:43.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:43.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:43.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:43.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:43.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:43.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:43.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:43.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:43.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:43.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:43.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:43.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:44.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1737 2024-09-14T22:05:44.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:44.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1739 2024-09-14T22:05:44.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1740 2024-09-14T22:05:44.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:44.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:44.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:44.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:44.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:45.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:45.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:45.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:45.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:45.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1742 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:45.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:45.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:46.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1741 2024-09-14T22:05:46.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:46.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:46.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:46.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:46.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:46.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:46.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:46.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1744 2024-09-14T22:05:46.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:47.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1743 2024-09-14T22:05:47.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:47.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:47.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:47.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:47.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:47.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:47.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:47.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:47.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:47.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:47.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:47.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:47.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:47.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:47.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1746 2024-09-14T22:05:47.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:48.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1745 2024-09-14T22:05:48.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:48.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:48.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:48.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:48.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:48.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:48.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:48.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1748 2024-09-14T22:05:48.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:49.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1747 2024-09-14T22:05:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:49.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:49.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:49.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:49.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:49.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:49.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:50.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1749 2024-09-14T22:05:50.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1750 2024-09-14T22:05:50.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:50.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:50.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:50.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1752 2024-09-14T22:05:50.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:50.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:50.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:50.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:50.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:50.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:50.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:51.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1751 2024-09-14T22:05:51.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:51.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1754 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:51.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:51.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:51.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:52.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1753 2024-09-14T22:05:52.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:52.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:52.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1756 2024-09-14T22:05:52.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:53.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1755 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:53.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:53.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:53.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1758 2024-09-14T22:05:53.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:53.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:54.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1757 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:54.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:05:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:54.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:05:54.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:05:54.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1759 2024-09-14T22:05:54.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1760 2024-09-14T22:05:54.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:54.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:55.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:55.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:55.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:55.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:55.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:55.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:05:55.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:55.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:05:55.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:55.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:55.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:05:55.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:05:55.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1762 2024-09-14T22:05:55.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:56.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:56.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:05:56.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:56.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:56.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:05:56.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:05:56.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1761 2024-09-14T22:05:56.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:05:56.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:05:56.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1764 2024-09-14T22:05:56.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:57.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1763 2024-09-14T22:05:57.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:05:57.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:05:57.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1765 2024-09-14T22:05:57.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1766 2024-09-14T22:05:57.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:57.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:05:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:57.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:05:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:05:57.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:57.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:05:57.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:57.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:57.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:05:57.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:05:58.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1768 2024-09-14T22:05:58.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:05:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:05:58.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:05:59.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1767 2024-09-14T22:05:59.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:05:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:05:59.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:00.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1770 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:00.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1769 2024-09-14T22:06:00.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:00.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:00.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1771 2024-09-14T22:06:00.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:00.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:00.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:00.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:00.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:00.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:00.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:00.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:00.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:00.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:00.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:00.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:00.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:00.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1772 2024-09-14T22:06:00.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:01.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:01.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1773 2024-09-14T22:06:01.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1774 2024-09-14T22:06:01.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:01.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:02.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:02.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:02.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:02.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:02.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:02.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:03.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1775 2024-09-14T22:06:03.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1776 2024-09-14T22:06:03.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:03.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:03.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1778 2024-09-14T22:06:03.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:03.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:03.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:03.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:03.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:03.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:03.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:03.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:03.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:03.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:03.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:03.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:03.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:03.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:03.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:03.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:03.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:03.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:03.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:03.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:04.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1777 2024-09-14T22:06:04.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:04.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1780 2024-09-14T22:06:04.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:04.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1779 2024-09-14T22:06:04.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:04.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:04.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:06.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:06.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:06.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1782 2024-09-14T22:06:06.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1781 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:06.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:06.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:06.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1784 2024-09-14T22:06:06.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:06.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1783 2024-09-14T22:06:06.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:07.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1785 2024-09-14T22:06:07.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1786 2024-09-14T22:06:07.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:07.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:07.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:07.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:07.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:07.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:07.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:08.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1788 2024-09-14T22:06:08.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:09.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1787 2024-09-14T22:06:09.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:09.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:09.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:09.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:09.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:09.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:09.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:09.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:09.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:09.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:09.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:09.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:09.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:09.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:10.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:10.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:10.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:10.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:10.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:10.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:10.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:10.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:10.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:10.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:10.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:10.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:10.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1790 2024-09-14T22:06:10.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1789 2024-09-14T22:06:10.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:10.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1791 2024-09-14T22:06:10.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1792 2024-09-14T22:06:10.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:10.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:11.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:12.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1793 2024-09-14T22:06:12.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1794 2024-09-14T22:06:12.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:12.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:12.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:12.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:13.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1795 2024-09-14T22:06:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1796 2024-09-14T22:06:13.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:13.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:13.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1798 2024-09-14T22:06:13.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:13.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:13.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:13.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:13.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:13.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:13.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:13.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:13.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:13.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:14.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1797 2024-09-14T22:06:14.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1800 2024-09-14T22:06:14.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1799 2024-09-14T22:06:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:15.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:15.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:15.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:15.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:15.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:15.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:15.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:15.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:15.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:15.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:15.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:15.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:16.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1801 2024-09-14T22:06:16.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1802 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:16.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:16.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:16.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:16.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:16.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1804 2024-09-14T22:06:16.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1803 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:16.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:16.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:16.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:17.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1805 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:17.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:17.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1806 2024-09-14T22:06:17.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:17.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:17.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:18.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1808 2024-09-14T22:06:18.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:19.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1807 2024-09-14T22:06:19.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:19.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:19.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:19.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:19.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:19.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:19.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:19.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:19.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:19.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:20.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1809 2024-09-14T22:06:20.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1810 2024-09-14T22:06:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:20.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:20.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:20.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:20.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:20.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:20.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:20.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1812 2024-09-14T22:06:20.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:20.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1811 2024-09-14T22:06:20.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:21.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:22.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1814 2024-09-14T22:06:22.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1813 2024-09-14T22:06:22.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:22.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:23.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1815 2024-09-14T22:06:23.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1816 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:23.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:23.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:23.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:23.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1818 2024-09-14T22:06:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:23.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:23.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:23.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:23.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:23.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:23.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:23.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:24.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1817 2024-09-14T22:06:24.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:24.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1819 2024-09-14T22:06:24.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1820 2024-09-14T22:06:24.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:24.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:25.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:25.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:25.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:25.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:25.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:25.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:26.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1822 2024-09-14T22:06:26.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1821 2024-09-14T22:06:26.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:26.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:26.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:26.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:26.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:26.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:26.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:26.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:26.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:26.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1823 2024-09-14T22:06:26.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1824 2024-09-14T22:06:26.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:26.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:26.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:27.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1825 2024-09-14T22:06:27.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1826 2024-09-14T22:06:27.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:27.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:27.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:27.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:27.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:27.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:27.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:27.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:27.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:27.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:27.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:27.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:27.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:27.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:27.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:28.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1828 2024-09-14T22:06:28.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1827 2024-09-14T22:06:29.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:29.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:29.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:29.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:29.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:29.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:29.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:29.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:29.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:29.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:29.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:29.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:29.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:30.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:30.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:30.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:30.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:30.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:30.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:30.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1829 2024-09-14T22:06:30.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1830 2024-09-14T22:06:30.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:30.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:30.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1832 2024-09-14T22:06:30.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1831 2024-09-14T22:06:30.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:30.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:32.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1834 2024-09-14T22:06:32.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1833 2024-09-14T22:06:32.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:32.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:32.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:32.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:32.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:32.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:32.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:32.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:33.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1835 2024-09-14T22:06:33.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1836 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:33.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:33.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:33.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:33.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:33.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:33.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:33.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:33.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:33.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:33.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:33.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1838 2024-09-14T22:06:33.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:34.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1837 2024-09-14T22:06:34.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:34.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1839 2024-09-14T22:06:34.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1840 2024-09-14T22:06:34.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:35.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:35.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:35.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:35.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:35.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:35.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:36.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1841 2024-09-14T22:06:36.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1842 2024-09-14T22:06:36.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:36.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:36.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:36.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:36.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:36.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:36.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1844 2024-09-14T22:06:36.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1843 2024-09-14T22:06:36.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:36.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:36.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:37.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1846 2024-09-14T22:06:37.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1845 2024-09-14T22:06:37.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:37.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:37.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:37.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:37.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:37.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:37.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:37.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:37.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:37.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:38.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1848 2024-09-14T22:06:38.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1847 2024-09-14T22:06:39.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:39.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:39.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:39.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:39.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:39.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:39.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:39.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:39.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:39.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:39.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:39.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:39.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:39.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:39.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:39.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:40.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:40.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:40.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:40.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:40.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:40.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:40.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:40.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1849 2024-09-14T22:06:40.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1850 2024-09-14T22:06:40.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:40.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:40.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1852 2024-09-14T22:06:40.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1851 2024-09-14T22:06:40.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:40.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:41.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:42.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1854 2024-09-14T22:06:42.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1853 2024-09-14T22:06:42.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:42.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:42.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:42.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:42.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:42.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:42.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:42.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:43.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1856 2024-09-14T22:06:43.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1855 2024-09-14T22:06:43.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:43.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:43.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1858 2024-09-14T22:06:43.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:43.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:43.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:43.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:43.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:43.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:44.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1857 2024-09-14T22:06:44.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1860 2024-09-14T22:06:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1859 2024-09-14T22:06:44.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:44.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:45.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:45.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:45.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:45.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:45.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:45.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:45.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:46.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1862 2024-09-14T22:06:46.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1861 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:46.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:46.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:46.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:46.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:46.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:46.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:46.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:46.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:46.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1863 2024-09-14T22:06:46.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1864 2024-09-14T22:06:46.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:46.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:46.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:46.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:46.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:46.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:46.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:46.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:47.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:47.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1865 2024-09-14T22:06:47.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1866 2024-09-14T22:06:47.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:47.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:48.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1868 2024-09-14T22:06:48.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:49.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1867 2024-09-14T22:06:49.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:49.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:49.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:49.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:49.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:49.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:49.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:49.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:49.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:49.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1870 2024-09-14T22:06:50.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1869 2024-09-14T22:06:50.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:50.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:50.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:50.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:50.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:50.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:50.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:50.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:50.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1872 2024-09-14T22:06:50.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:50.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1871 2024-09-14T22:06:50.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:51.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:52.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1874 2024-09-14T22:06:52.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1873 2024-09-14T22:06:52.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:52.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:52.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:52.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:52.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:52.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:52.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:52.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:53.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1875 2024-09-14T22:06:53.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1876 2024-09-14T22:06:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:53.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:53.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:53.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:53.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:53.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:53.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1878 2024-09-14T22:06:53.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:53.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:53.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:54.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1877 2024-09-14T22:06:54.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:54.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1880 2024-09-14T22:06:54.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1879 2024-09-14T22:06:54.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:54.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:55.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:56.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1882 2024-09-14T22:06:56.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1881 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:06:56.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:06:56.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:06:56.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:56.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:56.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1883 2024-09-14T22:06:56.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1884 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:06:56.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:06:56.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:56.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:57.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1886 2024-09-14T22:06:57.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1885 2024-09-14T22:06:57.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:57.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:06:57.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:06:57.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:06:57.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:06:58.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1890 2024-09-14T22:06:58.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:59.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1887 2024-09-14T22:06:59.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:59.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:06:59.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:59.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:59.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:06:59.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:06:59.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:59.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:06:59.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:59.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:59.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:06:59.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:06:59.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:06:59.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:59.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:06:59.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:59.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:59.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:06:59.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:06:59.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:06:59.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:06:59.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:06:59.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:06:59.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:06:59.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:00.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:00.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:00.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:00.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:00.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:00.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:00.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:00.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1889 2024-09-14T22:07:00.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1888 2024-09-14T22:07:00.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:00.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:00.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1892 2024-09-14T22:07:00.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1891 2024-09-14T22:07:00.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:00.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:01.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:02.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1894 2024-09-14T22:07:02.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1893 2024-09-14T22:07:02.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:02.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:02.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:02.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:02.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:02.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:02.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:02.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:03.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1895 2024-09-14T22:07:03.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1896 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:03.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:03.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:03.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:03.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:03.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1898 2024-09-14T22:07:03.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:03.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:03.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:03.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:03.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:03.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:03.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:03.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:03.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:03.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:03.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:03.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:03.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:04.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1897 2024-09-14T22:07:04.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:04.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1899 2024-09-14T22:07:04.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1900 2024-09-14T22:07:04.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:04.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:05.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:05.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:05.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:05.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:05.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:05.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:05.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:05.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:05.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:05.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:05.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:05.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:06.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1902 2024-09-14T22:07:06.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1901 2024-09-14T22:07:06.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:06.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:06.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:06.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:06.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:06.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:06.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:06.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:06.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:06.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:06.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:06.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:06.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:06.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1904 2024-09-14T22:07:06.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1903 2024-09-14T22:07:06.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:06.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:06.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:06.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:06.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:06.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:06.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:06.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:07.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1905 2024-09-14T22:07:07.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1906 2024-09-14T22:07:07.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:07.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:07.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:07.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:07.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:07.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:07.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:07.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:07.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:07.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:07.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:07.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:07.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:07.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:07.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:07.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:08.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1908 2024-09-14T22:07:08.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:09.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1907 2024-09-14T22:07:09.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:09.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:09.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:09.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:09.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:09.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:09.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:09.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:09.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:09.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:09.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:09.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:09.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:09.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:10.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1910 2024-09-14T22:07:10.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1909 2024-09-14T22:07:10.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:10.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:10.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1911 2024-09-14T22:07:10.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:10.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:10.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:10.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:10.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:10.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:10.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:10.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:10.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:10.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:10.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:10.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:10.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1912 2024-09-14T22:07:10.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:11.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:12.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1913 2024-09-14T22:07:12.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1914 2024-09-14T22:07:12.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:12.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:12.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:12.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:12.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:12.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:12.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:12.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:13.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1915 2024-09-14T22:07:13.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1916 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:13.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:13.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:13.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:13.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:13.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:13.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:13.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:13.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:13.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:13.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:13.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:13.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:13.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:13.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:13.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:13.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:13.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1918 2024-09-14T22:07:13.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:14.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1917 2024-09-14T22:07:14.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:14.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1919 2024-09-14T22:07:14.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:14.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1920 2024-09-14T22:07:14.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:15.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:15.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:15.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:15.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:15.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:15.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:15.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1922 2024-09-14T22:07:16.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1921 2024-09-14T22:07:16.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:16.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:16.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:16.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:16.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:16.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:16.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:16.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:16.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:16.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:16.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:16.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:16.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:16.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:16.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:16.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1923 2024-09-14T22:07:16.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1924 2024-09-14T22:07:16.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:16.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:17.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1926 2024-09-14T22:07:17.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1927 2024-09-14T22:07:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:17.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:17.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:17.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:17.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:17.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:18.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1928 2024-09-14T22:07:18.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:19.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1925 2024-09-14T22:07:19.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:19.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:19.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:19.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:19.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:19.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:19.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:19.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:19.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:19.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:20.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:20.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1929 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1930 2024-09-14T22:07:20.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:20.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:20.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1932 2024-09-14T22:07:20.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1931 2024-09-14T22:07:20.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:20.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:21.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:22.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1934 2024-09-14T22:07:22.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1933 2024-09-14T22:07:22.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1936 2024-09-14T22:07:22.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:22.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1935 2024-09-14T22:07:22.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:22.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:22.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:22.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:22.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:22.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:23.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1938 2024-09-14T22:07:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:23.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:23.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:23.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:23.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:23.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:23.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:23.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:23.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:23.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:23.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:23.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:24.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1937 2024-09-14T22:07:24.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1940 2024-09-14T22:07:24.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1939 2024-09-14T22:07:24.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:24.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:25.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:25.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:25.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:25.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:25.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:25.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:25.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:25.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:25.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:25.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:25.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:25.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:25.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:26.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1942 2024-09-14T22:07:26.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1941 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:07:26.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:07:26.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:26.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:26.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1944 2024-09-14T22:07:26.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1943 2024-09-14T22:07:26.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:26.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:07:27.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:07:27.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:27.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:27.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:27.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:27.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:27.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:28.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1946 2024-09-14T22:07:28.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1945 2024-09-14T22:07:28.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:28.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:28.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1948 2024-09-14T22:07:28.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:29.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1947 2024-09-14T22:07:29.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:29.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:29.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:07:29.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:29.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:29.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:07:29.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:07:29.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:29.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:29.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:29.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:29.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:29.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:07:29.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:07:30.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1950 2024-09-14T22:07:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1949 2024-09-14T22:07:30.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:30.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1951 2024-09-14T22:07:30.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1952 2024-09-14T22:07:30.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:30.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:31.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:31.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:07:31.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:31.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:07:31.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:07:32.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1954 2024-09-14T22:07:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1953 2024-09-14T22:07:32.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:32.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:32.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1955 2024-09-14T22:07:32.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1956 2024-09-14T22:07:32.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:32.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:32.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:32.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95290 2024-09-14T22:07:33.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:33.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95422 2024-09-14T22:07:33.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:33.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:33.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:33.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:33.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:33.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:33.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:33.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:07:33.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:33.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:33.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:07:33.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:07:33.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:33.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95554 2024-09-14T22:07:34.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1957 2024-09-14T22:07:34.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1958 2024-09-14T22:07:34.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:35.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:35.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95706 2024-09-14T22:07:35.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:35.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:07:35.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:35.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:35.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:07:35.716 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:07:35.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:35.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95859 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:07:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:07:36.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1959 2024-09-14T22:07:36.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:36.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1960 2024-09-14T22:07:36.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96033 2024-09-14T22:07:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:07:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:07:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:07:37.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:07:37.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:07:37.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:07:38.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1961 2024-09-14T22:07:38.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:39.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:39.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96206 2024-09-14T22:07:39.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:39.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96380 2024-09-14T22:07:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1962 2024-09-14T22:07:40.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:07:41.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:07:41.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96575 2024-09-14T22:07:43.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:07:43.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:07:43.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95159 2024-09-14T22:10:07.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:07.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:07.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:07.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95291 2024-09-14T22:10:08.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:08.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:08.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:08.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95423 2024-09-14T22:10:09.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:09.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:09.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:09.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95555 2024-09-14T22:10:10.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:10.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:10.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:10.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95707 2024-09-14T22:10:11.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:11.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:11.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:11.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 95860 2024-09-14T22:10:12.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:12.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:12.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:12.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96034 2024-09-14T22:10:14.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:14.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:14.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:14.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96207 2024-09-14T22:10:15.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:15.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96381 2024-09-14T22:10:16.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:16.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:16.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:10:16.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 96576 2024-09-14T22:10:18.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:10:18.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:10:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:10:18.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:10:18.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:10:18.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:10:18.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:10:18.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:10:18.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:10:18.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:10:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102467 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:10:18.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:10:18.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:10:18.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:10:18.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:10:18.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:10:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:10:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:10:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:10:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:10:19.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:10:19.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:10:19.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:10:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:10:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:10:19.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:10:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:10:19.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:10:19.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:10:19.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:10:19.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:11:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ae8afe6e920b6484b5e19e3f160c2e7e 2024-09-14T22:11:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:11:10.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:11:10.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:10.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:10.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:10.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:11:11.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:11.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:12.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:12.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:12.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:11:12.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:12.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:12.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:12.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:12.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:12.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:12.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:12.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:12.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=951961c075946373f76550e923345302 2024-09-14T22:11:12.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:11:12.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ef1707a2dc1b42481fb2bf53d3954ba6 2024-09-14T22:11:12.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:11:13.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:11:13.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:13.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:13.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:13.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:11:13.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:11:13.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:13.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:13.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:13.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:11:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0bd37b6be49c7c043955e84f594b1a8b 2024-09-14T22:11:13.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:11:13.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:11:13.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:13.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:13.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:13.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:11:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=5aba826093abe599bd8f328403b59622 2024-09-14T22:11:13.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:11:13.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=900f6a1c23a8cc4198a1262973c439d5 2024-09-14T22:11:13.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:11:13.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:11:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:11:14.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:14.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:14.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:11:14.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:14.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:14.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:14.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:11:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:11:14.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:14.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:14.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:14.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:14.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:14.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:14.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:14.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:14.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:14.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:14.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:14.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=9055f9fbec7513ad1f631c3db1c3c2a0 2024-09-14T22:11:14.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:11:15.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:11:15.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:15.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:11:15.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=9c3c8c60b93c5f8e449df83c7dbc7fc1 2024-09-14T22:11:15.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:11:15.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:15.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:15.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:15.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:15.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:15.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:11:15.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:15.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:15.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:15.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:15.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:11:15.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:15.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:15.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:15.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:11:15.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:15.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:15.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:15.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:15.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:15.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:15.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:15.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:15.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4b53237cbadb1f2567b25f60764d487c 2024-09-14T22:11:15.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:11:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:11:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:16.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:11:16.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:16.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:16.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:16.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:16.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:16.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:11:16.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:16.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:16.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:16.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:16.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:16.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:16.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:16.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:16.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:16.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:16.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=6d878a4a2b0bbbba300e041edcdacaf4 2024-09-14T22:11:16.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:11:17.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:11:17.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:17.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:11:17.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:17.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:11:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:11:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:17.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:17.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:17.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:17.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:17.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:11:17.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:17.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:17.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:11:17.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:11:17.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:11:17.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:17.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:17.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:17.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:17.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:17.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:11:17.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:11:17.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:17.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:17.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:17.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:17.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:17.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:17.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:17.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:17.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:17.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:17.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:17.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:17.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:17.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:17.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:17.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:17.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:17.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:17.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:17.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:17.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:17.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:18.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:18.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:18.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:18.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:18.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:18.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:18.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:18.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:18.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:18.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:18.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:18.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:11:18.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:18.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:18.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:18.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:11:18.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:18.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:18.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:18.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:11:18.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:18.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:18.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:18.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:18.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:18.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:18.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:18.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:18.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:18.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:18.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:18.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:19.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:19.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:19.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:19.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:19.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:11:19.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:11:19.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:19.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:19.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:19.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:19.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:19.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:19.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:19.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:11:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:11:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:11:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:19.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:19.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:19.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:19.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:19.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:11:19.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:19.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:19.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:19.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:19.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:19.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:19.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:20.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:20.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:20.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:20.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:11:20.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:11:20.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:20.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:20.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:20.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:20.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:20.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:20.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:20.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:20.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:11:20.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:11:20.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:11:20.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:20.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:20.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:20.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:20.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:20.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:20.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:20.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:20.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:20.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:11:21.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:21.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:21.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:21.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:21.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:11:21.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:21.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:21.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:21.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:21.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:21.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:21.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:21.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:21.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:21.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:21.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:21.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:11:22.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:22.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:22.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:22.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:22.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:22.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:22.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:22.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:22.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:22.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:22.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:22.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:11:22.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:22.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:22.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:22.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:22.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:22.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:22.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:22.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:22.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:22.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:22.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:22.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:22.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:11:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:23.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:23.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:23.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:23.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:23.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:23.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:23.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:23.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:11:23.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:23.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:11:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:23.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:11:23.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:11:23.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:11:23.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:23.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:23.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:23.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:23.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:23.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:23.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:23.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:23.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:23.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:23.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:11:23.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:11:23.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:23.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:23.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:23.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:23.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:23.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:23.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:23.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:24.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:24.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:24.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:24.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:24.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:24.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:11:24.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:24.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:24.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:24.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:24.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:24.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:24.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:24.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:24.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:24.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:26.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:11:27.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:27.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:27.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:27.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:27.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:27.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:27.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:27.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:27.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:27.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:29.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:29.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:29.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:29.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:11:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:29.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:29.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:29.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:30.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:30.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:30.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:30.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:11:30.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:30.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:30.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:30.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:30.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:30.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:30.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:30.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:30.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:30.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:30.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:30.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:30.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:30.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:30.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:11:30.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:30.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:30.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:30.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:30.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:30.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:30.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:30.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:11:30.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:11:30.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:30.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:01' 2024-09-14T22:11:30.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:30.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:11:30.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:30.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:11:31.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:11:31.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:11:31.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:11:31.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:11:31.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:31.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:31.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:31.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:31.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:31.741 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:31.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:31.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:11:31.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:31.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:31.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:31.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:31.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:31.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:31.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:31.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:31.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:31.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:31.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:31.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:31.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:31.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:31.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:11:31.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:31.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:31.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:11:31.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:31.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:31.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:11:31.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:11:31.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:11:31.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:31.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:11:31.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:31.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:31.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:31.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:31.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:31.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:31.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:31.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:31.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:31.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:31.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:11:31.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:31.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:31.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:32.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:11:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:11:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:32.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:32.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:32.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:32.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:32.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:32.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:32.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:32.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:32.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:32.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:32.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:32.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:32.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:32.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:11:32.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:11:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:11:32.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:11:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:32.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:11:32.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:32.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:32.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:32.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:11:33.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:11:33.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:33.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:33.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:33.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:33.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:11:33.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:11:33.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:33.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:33.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:33.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:33.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:33.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:33.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:33.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:33.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:33.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:33.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:33.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:33.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:33.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:33.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:33.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:33.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:33.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:33.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:11:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:11:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:11:33.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:11:33.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:11:33.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:11:33.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:33.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:33.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:33.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:33.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:33.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:33.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:11:33.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:33.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:11:33.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:11:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:11:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:33.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:11:33.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:11:33.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:33.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:33.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:11:33.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:11:33.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:11:33.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:33.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:33.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:33.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:33.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:33.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:33.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:33.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:33.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:33.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:33.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:33.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:33.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:33.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:33.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:33.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:33.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:33.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:33.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:33.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:33.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:33.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:33.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:33.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:33.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:33.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:33.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:33.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:33.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:34.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:11:34.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:11:34.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:11:34.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:34.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:11:34.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:34.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:11:34.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:11:34.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:11:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:11:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:11:34.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:34.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:34.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:34.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:11:34.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:34.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:34.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:11:34.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:34.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:34.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:11:34.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:34.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:34.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:34.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:34.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:11:34.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:34.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:34.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:11:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:11:35.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:11:35.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:35.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:35.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:35.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:11:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:11:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:11:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:35.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:35.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:35.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:35.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:35.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:35.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:35.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:35.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:35.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:35.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:35.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:35.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:11:35.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:35.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:11:35.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:35.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:35.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:35.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:35.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:35.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:35.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:35.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:35.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:35.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:36.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:11:36.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:36.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:36.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:36.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:36.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:36.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:36.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:36.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:36.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:36.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:36.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:36.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:11:36.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:11:36.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:36.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:36.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:36.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:36.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:36.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:11:36.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:36.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:36.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:11:36.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:36.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:11:37.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:37.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:37.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:37.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:11:37.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:37.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:37.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:11:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:38.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:38.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:38.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:38.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:38.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:38.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:38.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:38.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:38.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:38.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:38.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:38.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:11:38.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:11:38.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:38.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:38.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:38.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:38.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:38.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:38.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:38.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:38.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:11:38.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:11:38.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:38.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:38.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:38.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:38.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:11:38.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:38.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:38.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:38.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:11:38.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:11:38.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:38.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:38.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:38.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:38.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:11:38.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:38.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:11:38.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:38.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:38.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:38.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:38.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:38.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:38.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:38.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:38.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:38.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:38.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:38.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:38.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:38.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:38.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:38.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:38.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:38.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:38.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:38.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:38.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:38.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:38.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:38.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:38.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:39.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:39.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:11:39.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:39.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:11:39.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:39.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:39.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:39.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:39.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:39.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:39.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:11:39.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:39.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:11:39.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:39.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:39.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:39.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:11:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:11:39.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:11:39.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:39.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:39.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:39.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:39.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:39.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:39.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:39.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:39.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:39.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:39.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:39.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:39.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:39.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:39.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:11:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:39.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:39.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:39.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:39.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:39.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:39.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:39.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:39.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:39.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:39.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:39.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:39.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:39.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:39.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:39.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:39.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:39.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:39.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:39.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:39.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:39.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:11:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:39.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:11:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:39.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:39.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:39.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:39.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:11:40.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:40.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:40.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:11:40.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:40.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:11:40.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:40.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:40.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:40.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:11:40.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:11:40.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:40.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:11:40.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:40.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:40.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:11:40.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:40.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:40.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:11:40.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:11:40.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:11:40.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:40.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:40.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:40.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:40.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:40.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:40.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:40.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:40.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:40.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:40.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:40.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:40.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:11:31' 2024-09-14T22:11:40.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:11:40.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:11:40.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:11:40.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:11:40.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:11:40.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:11:40.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:40.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:40.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:11:40.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:11:40.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:11:40.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:11:40.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:11:31' 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:11:31' 2024-09-14T22:11:40.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:11:40.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:11:40.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:11:40.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:40.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:40.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:11:40.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:11:40.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:40.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:40.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:40.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:40.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:11:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:11:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:40.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:11:40.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:11:31' 2024-09-14T22:11:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:11:40.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:11:40.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:11:31' 2024-09-14T22:11:40.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:11:40.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:11:40.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:11:40.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:11:40.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:11:40.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:11:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:11:40.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:40.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:41.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:41.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:41.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:11:41.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:41.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:41.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:11:41.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:41.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:41.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:11:41.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:11:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:11:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:11:41.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:41.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:11:41.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:41.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:11:41.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:11:41.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:11:41.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:11:41.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:11:41.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:11:41.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:11:42.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:11:42.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:11:42.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:12:25.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=900f6a1c23a8cc4198a1262973c439d5 2024-09-14T22:12:25.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:12:26.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 900f6a1c23a8cc4198a1262973c439d5 != \9\0\0\f\6\a\1\c\2\3\a\8\c\c\4\1\9\8\a\1\2\6\2\9\7\3\c\4\3\9\d\5 ]] 2024-09-14T22:12:26.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=9c3c8c60b93c5f8e449df83c7dbc7fc1 2024-09-14T22:12:26.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:12:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=9055f9fbec7513ad1f631c3db1c3c2a0 2024-09-14T22:12:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:12:27.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 9055f9fbec7513ad1f631c3db1c3c2a0 != \9\0\5\5\f\9\f\b\e\c\7\5\1\3\a\d\1\f\6\3\1\c\3\d\b\1\c\3\c\2\a\0 ]] 2024-09-14T22:12:27.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 9c3c8c60b93c5f8e449df83c7dbc7fc1 != \9\c\3\c\8\c\6\0\b\9\3\c\5\f\8\e\4\4\9\d\f\8\3\c\7\d\b\c\7\f\c\1 ]] 2024-09-14T22:12:27.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:27.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102468 2024-09-14T22:12:27.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=6d878a4a2b0bbbba300e041edcdacaf4 2024-09-14T22:12:27.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:12:27.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 6d878a4a2b0bbbba300e041edcdacaf4 != \6\d\8\7\8\a\4\a\2\b\0\b\b\b\b\a\3\0\0\e\0\4\1\e\d\c\d\a\c\a\f\4 ]] 2024-09-14T22:12:27.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:27.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102470 2024-09-14T22:12:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4b53237cbadb1f2567b25f60764d487c 2024-09-14T22:12:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:12:29.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4b53237cbadb1f2567b25f60764d487c != \4\b\5\3\2\3\7\c\b\a\d\b\1\f\2\5\6\7\b\2\5\f\6\0\7\6\4\d\4\8\7\c ]] 2024-09-14T22:12:30.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ae8afe6e920b6484b5e19e3f160c2e7e 2024-09-14T22:12:30.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:12:30.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ae8afe6e920b6484b5e19e3f160c2e7e != \a\e\8\a\f\e\6\e\9\2\0\b\6\4\8\4\b\5\e\1\9\e\3\f\1\6\0\c\2\e\7\e ]] 2024-09-14T22:12:31.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=5aba826093abe599bd8f328403b59622 2024-09-14T22:12:31.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:12:31.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 5aba826093abe599bd8f328403b59622 != \5\a\b\a\8\2\6\0\9\3\a\b\e\5\9\9\b\d\8\f\3\2\8\4\0\3\b\5\9\6\2\2 ]] 2024-09-14T22:12:32.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ef1707a2dc1b42481fb2bf53d3954ba6 2024-09-14T22:12:32.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:12:32.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ef1707a2dc1b42481fb2bf53d3954ba6 != \e\f\1\7\0\7\a\2\d\c\1\b\4\2\4\8\1\f\b\2\b\f\5\3\d\3\9\5\4\b\a\6 ]] 2024-09-14T22:12:33.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=951961c075946373f76550e923345302 2024-09-14T22:12:33.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:12:33.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 951961c075946373f76550e923345302 != \9\5\1\9\6\1\c\0\7\5\9\4\6\3\7\3\f\7\6\5\5\0\e\9\2\3\3\4\5\3\0\2 ]] 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102472 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102474 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102476 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102478 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102480 2024-09-14T22:12:33.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102482 2024-09-14T22:12:33.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0bd37b6be49c7c043955e84f594b1a8b 2024-09-14T22:12:33.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:12:33.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0bd37b6be49c7c043955e84f594b1a8b != \0\b\d\3\7\b\6\b\e\4\9\c\7\c\0\4\3\9\5\5\e\8\4\f\5\9\4\b\1\a\8\b ]] 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 102483 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:34.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:34.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:34.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:12:34.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b26c3fce-84ea-42c4-93a8-47fd2928a6f5 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:34.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:34.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:34.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:34.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:34.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:34.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:34.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:34.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:34.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:34.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:34.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:34.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:34.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:34.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:34.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1b26c3fce-84ea-42c4-93a8-47fd2928a6f5up+replayingreplaying, {"bytes_per_second":3180544.0,"bytes_per_snapshot":63610880.0,"last_snapshot_bytes":63610880,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+replayingreplaying, {"bytes_per_second":3319603.2,"bytes_per_snapshot":66392064.0,"last_snapshot_bytes":66392064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+replayingreplaying, {"bytes_per_second":3156377.6,"bytes_per_snapshot":63127552.0,"last_snapshot_bytes":63127552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351901,"remote_snapshot_timestamp":1726351901,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+replayingreplaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+replayingreplaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:34.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:34.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:12:34.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:34.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:12:34.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:34.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:34.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:34.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:34.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:12:34.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:12:35.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:35.005+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5890f69c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:35.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:35.005+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5400 [3/b26c3fce-84ea-42c4-93a8-47fd2928a6f5] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:36.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:12:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:12:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:12:36.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:36.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:12:36.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:36.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:36.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:36.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:36.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:37.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:37.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:37.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:12:37.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:12:37.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 2aab7c92-caa0-4004-a4b7-89910ae611bb 2024-09-14T22:12:37.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:37.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3319603.2,"bytes_per_snapshot":66392064.0,"last_snapshot_bytes":66392064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"} 2024-09-14T22:12:37.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:37.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:37.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:37.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:37.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3319603.2,"bytes_per_snapshot":66392064.0,"last_snapshot_bytes":66392064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"} 2024-09-14T22:12:37.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:37.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:37.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:37.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:37.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:37.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:37.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:37.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:37.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:37.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:37.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:37.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary22aab7c92-caa0-4004-a4b7-89910ae611bbup+replayingreplaying, {"bytes_per_second":3319603.2,"bytes_per_snapshot":66392064.0,"last_snapshot_bytes":66392064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+replayingreplaying, {"bytes_per_second":3156377.6,"bytes_per_snapshot":63127552.0,"last_snapshot_bytes":63127552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351901,"remote_snapshot_timestamp":1726351901,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+replayingreplaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+replayingreplaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:37.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:37.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:12:37.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:37.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:12:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:37.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:37.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:37.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:37.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:12:37.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:12:37.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:37.723+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5890f6340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:37.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:37.723+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5680 [3/2aab7c92-caa0-4004-a4b7-89910ae611bb] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:39.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:39.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:12:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:12:39.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:39.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:39.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:39.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:40.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cfb319fa-f581-4183-a64d-38efcf6b92c6 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3156377.6,"bytes_per_snapshot":63127552.0,"last_snapshot_bytes":63127552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351901,"remote_snapshot_timestamp":1726351901,"replay_state":"idle"} 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:40.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:40.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:40.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:40.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3156377.6,"bytes_per_snapshot":63127552.0,"last_snapshot_bytes":63127552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351901,"remote_snapshot_timestamp":1726351901,"replay_state":"idle"} 2024-09-14T22:12:40.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:40.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:40.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:40.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:40.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:40.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:40.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:40.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:40.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary3cfb319fa-f581-4183-a64d-38efcf6b92c6up+replayingreplaying, {"bytes_per_second":3156377.6,"bytes_per_snapshot":63127552.0,"last_snapshot_bytes":63127552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351901,"remote_snapshot_timestamp":1726351901,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+replayingreplaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+replayingreplaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:40.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:40.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:12:40.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:40.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:12:40.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:40.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:40.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:40.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:12:40.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:12:40.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:40.666+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5896a6d00 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:40.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:40.666+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/cfb319fa-f581-4183-a64d-38efcf6b92c6] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:42.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:42.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:12:42.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:42.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:42.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:12:42.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:42.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:42.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:12:42.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:42.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:42.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:42.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:42.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:42.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:42.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:43.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:43.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:43.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02ecffd4-109e-47ed-af45-c60757d14119 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:43.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:43.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:43.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:43.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:43.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:43.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:43.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:43.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:43.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:43.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:43.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:43.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:43.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:43.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:43.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:43.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:43.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:43.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:43.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:43.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:43.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:43.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:43.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary402ecffd4-109e-47ed-af45-c60757d14119up+replayingreplaying, {"bytes_per_second":3201638.4,"bytes_per_snapshot":64032768.0,"last_snapshot_bytes":64032768,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+replayingreplaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:43.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:43.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:12:43.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:43.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:12:43.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:43.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:43.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:43.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:43.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:43.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:43.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:12:43.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:43.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:43.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:43.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:12:43.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:12:43.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:43.877+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5890f61a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:43.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:43.877+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/02ecffd4-109e-47ed-af45-c60757d14119] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:45.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:45.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:12:45.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:45.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:12:45.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:45.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:45.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:45.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:46.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:46.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:46.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:12:46.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:12:46.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d677ea04-0a3d-4dec-93da-8a2433bc780d 2024-09-14T22:12:46.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:46.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:46.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:46.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:46.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:46.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:46.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:46.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"} 2024-09-14T22:12:46.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:46.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:46.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:46.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:46.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:46.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:46.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:46.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:46.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:46.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary5d677ea04-0a3d-4dec-93da-8a2433bc780dup+replayingreplaying, {"bytes_per_second":3232768.0,"bytes_per_snapshot":64655360.0,"last_snapshot_bytes":64655360,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351893,"remote_snapshot_timestamp":1726351893,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:46.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:46.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:12:46.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:46.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:12:46.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:46.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:46.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:46.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:46.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:12:46.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:12:46.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:46.724+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58873d040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:46.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:46.724+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4f00 [3/d677ea04-0a3d-4dec-93da-8a2433bc780d] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:47.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:47.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:12:47.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:47.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:47.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:12:47.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:47.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:47.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:12:48.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:48.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:48.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:49.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:49.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:12:49.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:12:49.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 7ab8df44-3c2c-4d02-9225-cdab979fe3b1 2024-09-14T22:12:49.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:49.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:49.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:49.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:49.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:49.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:49.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:49.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:49.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:49.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:49.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:49.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:49.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:49.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:49.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:49.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary67ab8df44-3c2c-4d02-9225-cdab979fe3b1up+replayingreplaying, {"bytes_per_second":3269427.2,"bytes_per_snapshot":65388544.0,"last_snapshot_bytes":65388544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:49.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:49.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:12:49.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:49.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:12:49.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:49.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:49.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:49.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:12:49.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:12:49.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:49.472+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a964820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:49.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:49.472+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/7ab8df44-3c2c-4d02-9225-cdab979fe3b1] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:51.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:51.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:12:51.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:51.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:51.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:12:51.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:51.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:51.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:12:51.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:51.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:51.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:51.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:52.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:12:52.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:52.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:52.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:12:52.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:12:52.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 371a751d-69a5-43a4-9f2b-63e258fc4d1c 2024-09-14T22:12:52.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:52.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"} 2024-09-14T22:12:52.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:52.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:52.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:52.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:52.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:52.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"} 2024-09-14T22:12:52.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:52.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:52.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:52.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:52.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:52.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:52.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:52.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:52.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:52.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:52.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:52.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary7371a751d-69a5-43a4-9f2b-63e258fc4d1cup+replayingreplaying, {"bytes_per_second":3425075.2,"bytes_per_snapshot":68501504.0,"last_snapshot_bytes":68501504,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351897,"remote_snapshot_timestamp":1726351897,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:52.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:52.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:12:52.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:52.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:12:52.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:52.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:52.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:52.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:52.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:12:52.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:12:53.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:53.200+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588dcd040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:53.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:53.200+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/371a751d-69a5-43a4-9f2b-63e258fc4d1c] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:53.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:12:54.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:54.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:12:54.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:54.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:55.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:55.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:12:55.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 12f7ef39-c1ae-4cdb-90ce-d19799e89cfd 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:55.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:55.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:55.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:55.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:55.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:55.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:55.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:55.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:55.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:55.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:55.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:55.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:55.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:55.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:55.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:55.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary812f7ef39-c1ae-4cdb-90ce-d19799e89cfdup+replayingreplaying, {"bytes_per_second":3218022.4,"bytes_per_snapshot":64360448.0,"last_snapshot_bytes":64360448,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:55.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:55.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:12:55.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:55.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:12:55.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:55.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:55.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:55.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:55.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:12:55.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:12:55.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:55.466+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d38b60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:55.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:55.466+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/12f7ef39-c1ae-4cdb-90ce-d19799e89cfd] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:12:56.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:12:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:12:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:12:56.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:56.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:12:56.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:12:57.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:57.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:57.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:12:57.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:12:58.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:12:58.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:58.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:58.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:12:58.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:12:58.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e0365694-0f75-43d5-88bd-65c379544589 2024-09-14T22:12:58.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:12:58.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:58.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:12:58.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:12:31' 2024-09-14T22:12:58.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:12:58.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:12:58.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:12:58.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"} 2024-09-14T22:12:58.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:12:58.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:58.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:12:58.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:58.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:12:58.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:12:58.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:12:58.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:12:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:12:31' 2024-09-14T22:12:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:12:58.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:12:31' 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:12:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:12:58.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":3131801.6,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31image-primary9e0365694-0f75-43d5-88bd-65c379544589up+replayingreplaying, {"bytes_per_second":3337216.0,"bytes_per_snapshot":66744320.0,"last_snapshot_bytes":66744320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351900,"remote_snapshot_timestamp":1726351900,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:12:31' 2024-09-14T22:12:58.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:12:58.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:12:58.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:12:31' 2024-09-14T22:12:58.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:12:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:12:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:12:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:12:58.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:12:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:12:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:12:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:12:58.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:12:58.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:12:58.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:12:58.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:12:58.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:58.477+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7eba00 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:12:58.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:12:58.477+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/e0365694-0f75-43d5-88bd-65c379544589] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:13:00.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:13:00.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:13:00.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:00.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:00.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:00.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:13:00.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:13:00.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:13:00.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:00.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:13:00.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:00.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:13:00.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:13:00.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:13:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:13:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:13:01.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:13:01.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:13:01.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:13:01.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 8180131d-4eb0-4887-9476-9d2f01847a06 2024-09-14T22:13:01.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:13:01.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"} 2024-09-14T22:13:01.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:13:01.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:13:01' 2024-09-14T22:13:01.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:13:01.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:13:01.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:13:01.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"} 2024-09-14T22:13:01.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:13:01.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:13:01.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:13:01.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:13:01.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:13:01.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:13:01.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:13:01.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:13:01.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:13:01' 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:13:01' 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:13:01' 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:13:01.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:13:01.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary108180131d-4eb0-4887-9476-9d2f01847a06up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":62636032.0,"last_snapshot_bytes":62636032,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726351894,"remote_snapshot_timestamp":1726351894,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:13:01' 2024-09-14T22:13:01.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:13:01.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:13:01.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:13:01' 2024-09-14T22:13:01.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:13:01.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:13:01.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:13:01.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:13:01.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:01.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:13:01.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:13:01.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:13:01.768+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a4b8680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:13:01.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:13:01.768+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/8180131d-4eb0-4887-9476-9d2f01847a06] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:13:03.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:13:03.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:13:03.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:03.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:03.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:03.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:13:03.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:13:03.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:13:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:03.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:13:03.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T22:13:03.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T22:13:03.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T22:13:03.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:03.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:03.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:03.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:03.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:03.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:03.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T22:13:03.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T22:13:03.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:03.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T22:13:03.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2ddd5f0fd981 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2ddd5f0fd981 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:03 2024 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:03 2024 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:03 2024 2024-09-14T22:13:03.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:03.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:03.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:13:03.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:03.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:03.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:03.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T22:13:03.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T22:13:03.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:03.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T22:13:04.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 3f3e2a3d-caeb-4eda-b748-653edf0a4214 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:04.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:04.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:04.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:04.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:04.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:04.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:04.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T22:13:04.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T22:13:04.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:04.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T22:13:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T22:13:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T22:13:04.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:04.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:04.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T22:13:04.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:04.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T22:13:04.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:04.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1984 2024-09-14T22:13:04.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:04.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T22:13:04.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T22:13:04.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:04.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:04.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2ded323f27b2 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2ded323f27b2 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:04.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:04 2024 2024-09-14T22:13:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:04 2024 2024-09-14T22:13:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:04 2024 2024-09-14T22:13:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:04.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:13:04.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:04.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:04.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:04.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T22:13:04.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T22:13:04.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:04.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T22:13:04.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: fc1b716c-c070-4461-959e-a993f8f357c3 2024-09-14T22:13:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:04.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:04.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:04.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:05.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:05.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T22:13:05.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T22:13:05.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:05.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:05.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:13:05.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:05.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T22:13:05.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:05.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:05.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:05.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:05.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T22:13:05.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:05.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T22:13:05.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1986 2024-09-14T22:13:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T22:13:05.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2dfceac4189 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2dfceac4189 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:05 2024 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:05 2024 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:05 2024 2024-09-14T22:13:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:13:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:05.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:05.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:05.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T22:13:05.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T22:13:05.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:05.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T22:13:06.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:06.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b54b491a-3d1d-4310-8ff4-133814554d35 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:06.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:06.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:06.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:06.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:06.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T22:13:06.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T22:13:06.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:06.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:13:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T22:13:06.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T22:13:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:06.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T22:13:06.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:06.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T22:13:06.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:06.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1988 2024-09-14T22:13:06.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T22:13:06.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e0b85685214 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e0b85685214 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:06 2024 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:06 2024 2024-09-14T22:13:06.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:06 2024 2024-09-14T22:13:06.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:06.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:06.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:13:06.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:06.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:06.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:06.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T22:13:07.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T22:13:07.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:07.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T22:13:07.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 0ab8229b-6935-4a2b-aa0a-c9d946ca7380 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:07.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:07.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:07.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:07.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:07.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T22:13:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T22:13:07.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:07.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T22:13:07.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:07.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T22:13:07.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:13:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T22:13:07.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T22:13:07.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T22:13:07.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:07.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:07.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T22:13:07.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:07.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T22:13:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:07.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:07.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:07.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:07.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:07.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:07.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1990 2024-09-14T22:13:07.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T22:13:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:07.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T22:13:07.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e199cb27dd 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e199cb27dd 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:07 2024 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:07 2024 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:07 2024 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:07.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:07.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:13:07.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:07.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:07.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:07.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T22:13:08.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T22:13:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T22:13:08.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: c290119c-9e5e-48e2-ada8-f3f8450a01df 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:08.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:08.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:08.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:08.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T22:13:08.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T22:13:08.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:08.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T22:13:08.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:08.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T22:13:08.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:08.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:08.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:08.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T22:13:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T22:13:08.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:08.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:08.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:08.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:08.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:08.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:08.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1993 2024-09-14T22:13:08.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:08.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:08.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1992 2024-09-14T22:13:08.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:08.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e2bf5ab05ae 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e2bf5ab05ae 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:08.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:08 2024 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:08 2024 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:08 2024 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:13:08.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:08.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:08.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:08.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T22:13:09.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T22:13:09.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:09.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T22:13:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 0b43ee54-01ee-4950-a29e-75d4ac8440a6 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:09.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:09.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:09.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:09.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:09.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T22:13:09.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T22:13:09.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:09.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:09.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:09.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:09.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T22:13:09.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:09.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:09.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:09.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:09.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:09.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:09.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1996 2024-09-14T22:13:09.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1995 2024-09-14T22:13:09.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:09.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:09.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:09.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T22:13:10.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:10.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:10.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:10.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:10.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:10.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:10.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:10.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1998 2024-09-14T22:13:10.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T22:13:10.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:10.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T22:13:10.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e3b35973aaf 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e3b35973aaf 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:09 2024 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:09 2024 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:09 2024 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:10.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:10.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:13:10.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:10.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:10.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:10.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T22:13:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T22:13:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T22:13:11.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:11.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:11.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:11.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 4cdaacab-2014-400b-9705-1378f4317200 2024-09-14T22:13:11.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:11.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:11.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:11.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:11.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:11.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:11.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:11.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:11.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T22:13:11.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T22:13:11.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:11.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:11.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T22:13:11.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:11.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T22:13:11.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:11.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:11.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T22:13:11.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2000 2024-09-14T22:13:11.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:11.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 1999 2024-09-14T22:13:11.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:11.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T22:13:11.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:11.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:11.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:11.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:11.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T22:13:11.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:11.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:11.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:11.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:11.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:11.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:11.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e50e549f375 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e50e549f375 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:11 2024 2024-09-14T22:13:11.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:11 2024 2024-09-14T22:13:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:11 2024 2024-09-14T22:13:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:13:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:11.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:11.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:11.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T22:13:12.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T22:13:12.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:12.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T22:13:12.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:12.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: eb8ea016-add0-4c66-9daa-6ab1736c8bb5 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:12.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:12.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:12.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:12.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:12.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T22:13:12.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T22:13:12.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:12.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T22:13:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T22:13:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T22:13:12.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T22:13:12.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:12.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T22:13:12.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:12.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T22:13:12.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2002 2024-09-14T22:13:12.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:12.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2004 2024-09-14T22:13:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2003 2024-09-14T22:13:12.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T22:13:12.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:12.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:12.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:12.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:12.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:12.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e659e0ad0f0 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e659e0ad0f0 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:12 2024 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:12 2024 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:12 2024 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:12.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:12.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:13:12.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:12.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:12.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:12.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T22:13:13.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T22:13:13.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:13.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T22:13:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 7e827a4a-82f5-4f2e-9de9-2dadf4466edd 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:13.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:13.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:13.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:13.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T22:13:13.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T22:13:13.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:13.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:13.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:13:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:13:13.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:13:13.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:13:13.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T22:13:13.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2007 2024-09-14T22:13:13.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:13:13.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2008 2024-09-14T22:13:13.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2006 2024-09-14T22:13:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:13.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T22:13:13.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:13.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:13.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:13.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 2e7aaa17662a 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.2e7aaa17662a 2024-09-14T22:13:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:13:13 2024 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:13:13 2024 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:13:13 2024 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:13:13.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:13:13.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:13:13.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:13:13.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T22:13:14.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T22:13:14.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:13:14.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T22:13:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:13:14.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:13:14.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:13:14.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 1d72a3be-ddce-484b-9d91-8d0fd1567137 2024-09-14T22:13:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:13:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:13:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:13:14.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:13:14.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:13:14.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:13:14.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:13:14.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T22:13:14.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T22:13:14.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:13:14.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T22:13:14.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:13:14.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:14.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107034 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T22:13:14.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T22:13:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:13:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:14.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:14.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2011 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:14.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:14.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2010 2024-09-14T22:13:14.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:14.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:15.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:15.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:15.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:15.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:15.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:15.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:15.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:15.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:15.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2013 2024-09-14T22:13:15.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2012 2024-09-14T22:13:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:15.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:16.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2016 2024-09-14T22:13:16.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:16.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:16.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:16.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:16.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:16.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:16.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:16.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:16.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:16.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:16.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:16.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:16.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2014 2024-09-14T22:13:16.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2015 2024-09-14T22:13:16.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:16.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:16.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:16.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:16.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:16.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:16.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:16.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:16.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:17.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2019 2024-09-14T22:13:17.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2017 2024-09-14T22:13:17.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:17.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2018 2024-09-14T22:13:17.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:17.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:17.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:18.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:18.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:18.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2020 2024-09-14T22:13:18.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2021 2024-09-14T22:13:18.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:19.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:19.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:19.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:19.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:19.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:19.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:19.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:19.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:19.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2022 2024-09-14T22:13:19.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2023 2024-09-14T22:13:19.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:20.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:20.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:20.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:20.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:20.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:20.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:20.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:20.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:20.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2025 2024-09-14T22:13:20.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2024 2024-09-14T22:13:20.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2026 2024-09-14T22:13:20.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:20.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:20.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:21.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2029 2024-09-14T22:13:21.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2028 2024-09-14T22:13:21.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2027 2024-09-14T22:13:21.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:21.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:21.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:21.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:22.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2030 2024-09-14T22:13:22.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2031 2024-09-14T22:13:22.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:22.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:22.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:22.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:22.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:22.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:22.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:22.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:22.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:23.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2033 2024-09-14T22:13:23.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2032 2024-09-14T22:13:23.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:23.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:23.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:23.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:23.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:23.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:23.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:23.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:23.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:24.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2035 2024-09-14T22:13:24.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2034 2024-09-14T22:13:24.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:24.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:24.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:25.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:25.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:25.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:25.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:25.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:25.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:25.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:25.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2037 2024-09-14T22:13:25.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2038 2024-09-14T22:13:25.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:25.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:26.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2036 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:26.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:26.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:26.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:26.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:26.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:26.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:26.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:26.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:26.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2040 2024-09-14T22:13:27.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:27.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2039 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:27.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:27.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:27.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:27.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:27.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:27.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:27.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:27.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2043 2024-09-14T22:13:27.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:28.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2041 2024-09-14T22:13:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:28.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:28.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:28.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:28.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:28.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2044 2024-09-14T22:13:28.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:29.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2042 2024-09-14T22:13:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:29.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:29.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:29.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:29.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:29.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:29.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2046 2024-09-14T22:13:29.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:30.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:30.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2045 2024-09-14T22:13:30.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:30.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:30.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:30.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:30.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:30.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:30.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:30.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2049 2024-09-14T22:13:30.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2048 2024-09-14T22:13:30.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:30.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:31.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2047 2024-09-14T22:13:31.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:31.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:31.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:31.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:31.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:31.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:31.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:31.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2050 2024-09-14T22:13:31.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:31.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:31.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:31.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:31.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:31.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:31.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:32.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2052 2024-09-14T22:13:32.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:32.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:32.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:32.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:33.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2051 2024-09-14T22:13:33.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:33.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:33.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:33.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:33.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:33.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:33.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2054 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:33.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:33.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:34.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2053 2024-09-14T22:13:34.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:34.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:34.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:34.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:34.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:34.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2056 2024-09-14T22:13:34.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:35.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2055 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:35.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:35.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:35.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2059 2024-09-14T22:13:35.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:36.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2057 2024-09-14T22:13:36.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2058 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:36.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:36.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:36.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:36.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:37.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2060 2024-09-14T22:13:37.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:37.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2062 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:37.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:37.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:38.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2061 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:38.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:38.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:38.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2064 2024-09-14T22:13:38.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:38.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:38.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:38.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:38.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:38.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:38.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:39.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2063 2024-09-14T22:13:39.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:39.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2066 2024-09-14T22:13:39.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:40.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2065 2024-09-14T22:13:40.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:40.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:40.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:40.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:40.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:40.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:40.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:40.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2069 2024-09-14T22:13:40.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2068 2024-09-14T22:13:40.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:40.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:40.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:40.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:40.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:40.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:40.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:40.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:41.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2067 2024-09-14T22:13:41.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:41.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:41.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:41.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:41.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2070 2024-09-14T22:13:41.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:41.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:41.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:41.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:41.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:41.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:41.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:42.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2072 2024-09-14T22:13:42.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:42.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:42.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:42.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:42.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:42.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:42.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:42.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:42.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:43.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2071 2024-09-14T22:13:43.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:43.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2074 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:43.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:43.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:43.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:43.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:43.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:43.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:44.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2073 2024-09-14T22:13:44.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:44.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2076 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:44.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:44.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:44.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:44.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:44.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:44.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:44.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:44.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:45.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2075 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:45.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:45.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:45.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2079 2024-09-14T22:13:45.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:46.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2078 2024-09-14T22:13:46.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2077 2024-09-14T22:13:46.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:46.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:46.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:46.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:46.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:46.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:46.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:46.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:46.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:47.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2080 2024-09-14T22:13:47.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:47.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:47.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2083 2024-09-14T22:13:47.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:47.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:48.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2081 2024-09-14T22:13:48.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:48.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:48.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:48.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:48.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:48.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:48.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:48.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2084 2024-09-14T22:13:48.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:48.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:48.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:48.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:48.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:48.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:48.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:49.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2082 2024-09-14T22:13:49.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:49.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:49.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2086 2024-09-14T22:13:49.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:50.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2085 2024-09-14T22:13:50.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:50.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:50.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:50.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:50.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:50.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:50.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:50.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:50.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:50.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:50.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:50.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:50.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:50.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2089 2024-09-14T22:13:50.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2088 2024-09-14T22:13:50.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:50.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:51.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2087 2024-09-14T22:13:51.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:51.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:51.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2090 2024-09-14T22:13:51.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:52.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:52.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2092 2024-09-14T22:13:52.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:52.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:53.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2091 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:53.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:53.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:53.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2094 2024-09-14T22:13:53.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:53.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:53.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:53.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:53.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:53.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:54.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2093 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:54.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:54.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:54.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:54.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:13:54.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2095 2024-09-14T22:13:54.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:54.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2096 2024-09-14T22:13:54.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:55.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:55.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:13:55.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:55.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:55.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:13:55.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:13:55.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2097 2024-09-14T22:13:55.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2098 2024-09-14T22:13:55.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:55.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2099 2024-09-14T22:13:55.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:55.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2100 2024-09-14T22:13:56.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:13:56.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:13:56.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:13:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2102 2024-09-14T22:13:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:13:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:57.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:13:57.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:13:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:13:57.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:57.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:13:58.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:58.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:58.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:13:58.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:13:58.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2101 2024-09-14T22:13:58.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:58.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2104 2024-09-14T22:13:58.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:58.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:58.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:13:58.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:58.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:58.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:13:58.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:13:58.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:13:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:13:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:13:59.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:59.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:13:59.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:13:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:13:59.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2103 2024-09-14T22:13:59.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:13:59.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:13:59.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:13:59.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:13:59.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:13:59.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:13:59.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:00.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:00.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2106 2024-09-14T22:14:00.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2105 2024-09-14T22:14:00.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:00.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:01.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:01.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2109 2024-09-14T22:14:01.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2107 2024-09-14T22:14:01.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2108 2024-09-14T22:14:01.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:01.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:01.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:01.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:01.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:01.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:01.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:01.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:01.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:02.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2110 2024-09-14T22:14:02.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:02.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:02.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2111 2024-09-14T22:14:02.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2113 2024-09-14T22:14:02.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:02.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:03.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:03.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:03.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:03.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:03.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:03.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:03.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2114 2024-09-14T22:14:03.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:03.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:03.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:03.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:03.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:03.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:03.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:04.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2112 2024-09-14T22:14:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:04.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:04.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:04.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:04.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:04.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2115 2024-09-14T22:14:04.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:04.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2116 2024-09-14T22:14:05.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:05.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:05.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2117 2024-09-14T22:14:05.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2118 2024-09-14T22:14:05.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2119 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:05.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:05.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:05.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:05.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:05.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:06.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2120 2024-09-14T22:14:06.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:07.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:07.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:07.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:07.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:07.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:07.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:07.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:07.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:07.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:07.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:07.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:07.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:07.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:08.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:08.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2122 2024-09-14T22:14:08.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:08.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2121 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:08.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:08.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:08.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:08.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:08.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:08.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:08.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:08.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:08.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:08.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:08.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:08.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:08.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:08.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2124 2024-09-14T22:14:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:09.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2123 2024-09-14T22:14:09.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:09.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:09.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:09.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:09.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:09.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:09.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:10.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2125 2024-09-14T22:14:10.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2126 2024-09-14T22:14:10.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:10.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:11.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2128 2024-09-14T22:14:11.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2129 2024-09-14T22:14:11.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2127 2024-09-14T22:14:11.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:11.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:11.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:11.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:11.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:11.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:11.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:11.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:11.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:11.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:11.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:11.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:11.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:11.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:12.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:12.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:12.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:12.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:12.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:12.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:12.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2130 2024-09-14T22:14:12.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:12.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2132 2024-09-14T22:14:12.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2131 2024-09-14T22:14:12.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:12.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:13.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2134 2024-09-14T22:14:13.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:13.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:13.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:13.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:13.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:13.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:13.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:13.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:14.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2133 2024-09-14T22:14:14.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:14.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:14.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:14.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:14.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:14.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:14.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:14.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2136 2024-09-14T22:14:14.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:14.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:14.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:14.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:14.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:14.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:14.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2135 2024-09-14T22:14:14.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:14.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:14.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:14.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:14.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:14.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:14.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:15.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:15.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:15.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:15.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:15.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2139 2024-09-14T22:14:15.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2137 2024-09-14T22:14:15.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2138 2024-09-14T22:14:15.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:15.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:16.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2140 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:17.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:17.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:17.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:17.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:17.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:17.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:17.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:17.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:17.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:17.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:17.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:17.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:17.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:17.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:17.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:17.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:17.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:17.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:18.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2142 2024-09-14T22:14:18.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2141 2024-09-14T22:14:18.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:18.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:18.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2144 2024-09-14T22:14:18.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:18.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:18.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:18.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:18.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:18.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:18.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:18.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:19.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2143 2024-09-14T22:14:19.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:20.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2146 2024-09-14T22:14:20.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2145 2024-09-14T22:14:20.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:20.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:21.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2149 2024-09-14T22:14:21.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2148 2024-09-14T22:14:21.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2147 2024-09-14T22:14:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:21.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:21.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:21.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:21.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:21.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:21.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:21.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:21.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:21.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:21.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:21.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:21.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:21.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:21.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:21.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:21.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:21.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:21.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:22.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:22.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:22.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2150 2024-09-14T22:14:22.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:23.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2151 2024-09-14T22:14:23.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2152 2024-09-14T22:14:23.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:23.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:23.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2153 2024-09-14T22:14:23.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:23.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2154 2024-09-14T22:14:23.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:23.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:24.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2155 2024-09-14T22:14:24.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2156 2024-09-14T22:14:24.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:24.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:24.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:24.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:24.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:24.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:24.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:24.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:24.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:24.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:25.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2157 2024-09-14T22:14:25.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2158 2024-09-14T22:14:25.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2159 2024-09-14T22:14:25.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:25.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:25.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:25.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:25.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:25.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:25.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:25.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:25.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:26.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:26.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:26.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:26.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:26.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:26.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:26.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:26.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:26.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:26.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:26.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:26.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:26.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2160 2024-09-14T22:14:26.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:26.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:26.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:26.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:26.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:26.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:26.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:26.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:26.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:26.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:26.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:26.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:26.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:27.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:27.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:27.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:27.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:27.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:28.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2162 2024-09-14T22:14:28.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2161 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:28.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:28.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:28.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2164 2024-09-14T22:14:29.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:29.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:29.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:29.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:29.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:29.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:29.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2163 2024-09-14T22:14:29.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2165 2024-09-14T22:14:29.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:29.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:29.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2166 2024-09-14T22:14:30.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2168 2024-09-14T22:14:30.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:30.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2169 2024-09-14T22:14:30.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:30.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:31.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2167 2024-09-14T22:14:31.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:31.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:31.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:31.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:31.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:31.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:31.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:31.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:32.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2170 2024-09-14T22:14:32.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:32.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2172 2024-09-14T22:14:32.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2171 2024-09-14T22:14:32.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:32.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:32.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:32.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:32.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:32.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:32.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:32.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:32.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:32.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:32.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:32.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:33.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2173 2024-09-14T22:14:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2174 2024-09-14T22:14:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:33.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:33.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:34.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2176 2024-09-14T22:14:34.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:35.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:35.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:35.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:35.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:35.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:35.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:35.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2175 2024-09-14T22:14:35.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:35.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2179 2024-09-14T22:14:35.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:36.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2178 2024-09-14T22:14:36.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2177 2024-09-14T22:14:36.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:36.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:36.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:36.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:36.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:36.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:36.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2180 2024-09-14T22:14:36.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:37.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2181 2024-09-14T22:14:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:37.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:37.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:37.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:37.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:37.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:37.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:38.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2182 2024-09-14T22:14:38.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:38.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:39.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2184 2024-09-14T22:14:39.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2183 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:39.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:39.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:39.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:39.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:39.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:39.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:39.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:39.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:39.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:39.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2186 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:39.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:40.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:40.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:40.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:40.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:40.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:40.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:40.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2185 2024-09-14T22:14:40.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:40.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2189 2024-09-14T22:14:40.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2188 2024-09-14T22:14:40.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:40.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:41.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:41.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:41.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:41.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:41.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:41.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:41.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2187 2024-09-14T22:14:41.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:42.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2190 2024-09-14T22:14:42.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:42.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2192 2024-09-14T22:14:42.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:42.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:42.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:42.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:42.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:42.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:43.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2191 2024-09-14T22:14:43.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:43.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:43.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:43.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:43.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:43.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:43.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:43.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2194 2024-09-14T22:14:43.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2193 2024-09-14T22:14:43.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:43.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:43.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:44.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:44.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:44.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:44.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:44.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:44.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:44.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2195 2024-09-14T22:14:44.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:44.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2196 2024-09-14T22:14:44.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:45.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:45.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:45.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:45.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:45.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:45.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:45.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:45.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2198 2024-09-14T22:14:45.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2197 2024-09-14T22:14:45.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2199 2024-09-14T22:14:45.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:45.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:45.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:46.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2200 2024-09-14T22:14:46.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:46.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:46.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:46.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:46.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:46.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:46.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:46.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:46.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:46.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:46.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:46.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:46.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:46.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:47.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2201 2024-09-14T22:14:47.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:47.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2202 2024-09-14T22:14:47.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:47.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:47.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:47.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:47.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:47.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:47.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:47.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:48.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:48.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:48.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:48.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:48.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:48.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:48.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:49.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2203 2024-09-14T22:14:49.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2204 2024-09-14T22:14:49.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:49.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:49.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:49.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:49.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:49.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:49.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:49.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:50.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2205 2024-09-14T22:14:50.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2206 2024-09-14T22:14:50.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:50.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:50.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:50.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:50.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:50.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:50.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:50.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:50.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:50.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:50.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:50.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2209 2024-09-14T22:14:51.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2207 2024-09-14T22:14:51.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2208 2024-09-14T22:14:51.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:51.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:51.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:52.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2210 2024-09-14T22:14:52.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:52.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:53.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2212 2024-09-14T22:14:53.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2211 2024-09-14T22:14:53.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:53.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:53.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:53.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:53.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:53.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2213 2024-09-14T22:14:53.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2214 2024-09-14T22:14:53.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:53.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:54.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2215 2024-09-14T22:14:54.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2216 2024-09-14T22:14:54.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:54.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:54.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:54.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:54.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:54.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:54.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:54.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:54.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:54.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:54.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:54.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:54.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:54.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:55.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2218 2024-09-14T22:14:55.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2217 2024-09-14T22:14:55.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2219 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:55.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:55.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:55.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:55.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:56.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2220 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:14:56.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:14:56.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:56.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:14:56.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:56.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:56.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:14:56.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:14:56.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:56.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:14:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:14:56.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:14:56.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:14:57.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2221 2024-09-14T22:14:57.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2222 2024-09-14T22:14:57.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:57.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:14:57.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:14:57.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:14:58.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:58.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:14:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:14:58.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:14:58.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:14:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:14:58.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:14:58.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:14:59.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2223 2024-09-14T22:14:59.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:14:59.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:14:59.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:14:59.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:14:59.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:14:59.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:14:59.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2224 2024-09-14T22:14:59.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:14:59.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:00.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2225 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:00.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:00.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2226 2024-09-14T22:15:00.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:00.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:01.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2229 2024-09-14T22:15:01.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2227 2024-09-14T22:15:01.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2228 2024-09-14T22:15:01.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:01.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:01.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2230 2024-09-14T22:15:02.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:02.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:02.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:02.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:02.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:02.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:02.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:02.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:02.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:02.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:03.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2231 2024-09-14T22:15:03.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2232 2024-09-14T22:15:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:03.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:03.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:03.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:03.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:03.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:03.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2234 2024-09-14T22:15:03.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2233 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:03.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:03.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:03.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:04.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2236 2024-09-14T22:15:04.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2235 2024-09-14T22:15:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:04.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:15:04.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:15:04.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:04.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:04.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:04.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:04.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:04.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:05.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:05.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:15:05.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:05.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:05.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:15:05.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:15:05.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2238 2024-09-14T22:15:05.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2237 2024-09-14T22:15:05.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2239 2024-09-14T22:15:05.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:05.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:05.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:06.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:06.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:06.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:06.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:06.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:06.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:06.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:06.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:06.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:06.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:06.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:06.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:06.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2240 2024-09-14T22:15:06.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:06.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:06.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:06.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:06.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:06.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:06.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:06.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:06.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:06.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:06.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:06.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:06.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2241 2024-09-14T22:15:07.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2242 2024-09-14T22:15:07.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:07.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:07.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:07.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:07.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:07.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:15:08.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:08.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:08.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:08.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:08.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:09.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2243 2024-09-14T22:15:09.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2244 2024-09-14T22:15:09.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:09.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:09.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:09.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:15:09.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:09.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:09.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:15:09.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:15:10.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:10.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:10.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:10.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:10.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:10.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:10.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:10.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2245 2024-09-14T22:15:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2246 2024-09-14T22:15:10.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:10.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:11.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2247 2024-09-14T22:15:11.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2249 2024-09-14T22:15:11.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2248 2024-09-14T22:15:11.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:11.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:11.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:12.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2250 2024-09-14T22:15:12.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:12.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:12.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:12.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:12.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:12.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:12.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:13.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2251 2024-09-14T22:15:13.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2252 2024-09-14T22:15:13.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:13.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:13.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2254 2024-09-14T22:15:13.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2253 2024-09-14T22:15:13.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:13.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:13.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:14.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2256 2024-09-14T22:15:14.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2255 2024-09-14T22:15:14.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:14.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:15:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:14.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:14.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:15:15.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:15:15.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2259 2024-09-14T22:15:15.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2257 2024-09-14T22:15:15.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2258 2024-09-14T22:15:15.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:15.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:15.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:16.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:16.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:16.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:16.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:16.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:16.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:16.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:16.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:16.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2260 2024-09-14T22:15:16.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:17.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2261 2024-09-14T22:15:17.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2262 2024-09-14T22:15:17.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:17.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:17.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:17.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:17.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:17.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:17.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:17.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:17.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:18.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:18.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:18.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:18.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:18.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:18.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:15:18.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:18.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:18.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:15:18.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:19.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2263 2024-09-14T22:15:19.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2264 2024-09-14T22:15:19.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:19.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:15:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:15:20.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2265 2024-09-14T22:15:20.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2266 2024-09-14T22:15:20.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:20.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:20.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:21.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2269 2024-09-14T22:15:21.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2268 2024-09-14T22:15:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2267 2024-09-14T22:15:21.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:21.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:21.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:22.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2270 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:22.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:22.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:23.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2272 2024-09-14T22:15:23.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2271 2024-09-14T22:15:23.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:23.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:23.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:23.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:23.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2273 2024-09-14T22:15:23.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2274 2024-09-14T22:15:23.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:23.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:24.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2275 2024-09-14T22:15:24.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2276 2024-09-14T22:15:24.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:24.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:24.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:24.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:24.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:24.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:24.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:25.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2277 2024-09-14T22:15:25.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2279 2024-09-14T22:15:25.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2278 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:15:25.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:15:25.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:25.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:25.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:26.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2280 2024-09-14T22:15:26.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:26.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:26.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:26.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:26.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:26.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:26.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:15:26.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:15:26.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:15:26.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:26.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:26.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:15:26.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:15:27.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2281 2024-09-14T22:15:27.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2282 2024-09-14T22:15:27.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:27.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:27.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:27.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:27.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:15:27.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:27.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:27.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:15:27.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:15:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:28.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107166 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:28.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:28.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:28.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:15:28.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:15:28.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:15:29.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2283 2024-09-14T22:15:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107298 2024-09-14T22:15:29.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2284 2024-09-14T22:15:29.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:29.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:30.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2285 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:15:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:15:30.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:30.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107431 2024-09-14T22:15:30.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2286 2024-09-14T22:15:30.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:30.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2288 2024-09-14T22:15:30.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:30.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:31.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2287 2024-09-14T22:15:31.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:15:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:32.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:32.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:15:32.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:15:32.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:32.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107583 2024-09-14T22:15:33.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2289 2024-09-14T22:15:33.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:15:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:33.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:15:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:15:33.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2290 2024-09-14T22:15:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107736 2024-09-14T22:15:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:15:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:15:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:15:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:15:33.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:15:33.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:15:34.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:34.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107910 2024-09-14T22:15:34.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2291 2024-09-14T22:15:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:36.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2292 2024-09-14T22:15:36.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:36.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108083 2024-09-14T22:15:36.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:15:36.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:36.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108257 2024-09-14T22:15:37.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:15:37.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108411 2024-09-14T22:15:39.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:15:39.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:15:39.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107035 2024-09-14T22:18:04.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:04.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:04.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:04.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107167 2024-09-14T22:18:05.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:05.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:05.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:05.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107299 2024-09-14T22:18:06.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:06.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:06.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:06.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107432 2024-09-14T22:18:07.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:07.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:07.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:07.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107584 2024-09-14T22:18:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107737 2024-09-14T22:18:09.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:09.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:09.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:09.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 107911 2024-09-14T22:18:11.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:11.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:11.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:11.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108084 2024-09-14T22:18:12.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:12.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:12.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:12.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108258 2024-09-14T22:18:13.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:13.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:13.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:18:13.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 108412 2024-09-14T22:18:14.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:18:14.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:18:14.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:18:14.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:18:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:18:14.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:18:14.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:18:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:18:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:18:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:18:14.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:18:14.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:18:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:18:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:18:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:18:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:18:14.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:18:14.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:18:14.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:18:14.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:18:14.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:18:14.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:18:14.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:18:14.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:18:14.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114343 2024-09-14T22:18:15.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:18:15.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:18:15.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:18:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:18:15.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:18:15.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:18:15.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:18:15.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:18:15.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:18:15.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:18:15.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:18:15.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:07.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=eec00c64b5b54e715185cfc2a50790ad 2024-09-14T22:19:07.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:19:08.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:19:08.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:08.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:08.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:08.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:19:08.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c67612ae07a555f03e77b4bdd6be1622 2024-09-14T22:19:08.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:19:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=f7d8b26df40b873094049d274ee07109 2024-09-14T22:19:08.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:19:08.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:19:08.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:08.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:08.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:08.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:19:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:19:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:19:09.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ee5d627b38be4bd05cd41fddd888d4bf 2024-09-14T22:19:09.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:19:09.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:19:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:19:09.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:09.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:19:09.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:09.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:09.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:09.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:10.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4206ec3974cfe64f5c642f069381af90 2024-09-14T22:19:10.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:19:10.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=2ea50c68f63abd1dc2603756e14e02d9 2024-09-14T22:19:10.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:19:10.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:19:10.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:10.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:19:10.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:19:10.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:10.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:19:10.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:10.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:10.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:10.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:10.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:19:10.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:10.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:10.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:10.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:10.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:10.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:10.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:10.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:10.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:10.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:10.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:10.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:10.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:19:11.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:11.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:11.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:11.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:11.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:11.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:11.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:11.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:11.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:11.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c69c65564157e8ce9ec90ee6eb025ae9 2024-09-14T22:19:11.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:19:11.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:19:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:11.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:19:11.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=646cdbc592bc3f5e9ed9b9ffbbed141b 2024-09-14T22:19:11.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:19:11.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:19:11.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:11.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:19:11.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:11.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:11.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:11.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:19:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:11.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:11.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:11.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:11.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:19:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:11.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:11.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:11.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:12.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:12.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:12.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:12.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:12.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:12.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:12.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:12.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:12.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:12.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:12.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:12.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=096dcc99334f72fb85a439fbc6f7cfd6 2024-09-14T22:19:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:19:12.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:19:12.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:12.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:19:12.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:19:12.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:12.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:19:12.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:12.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:12.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:12.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:13.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:13.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4f55314ccfb78bde6aface8f3929f6d2 2024-09-14T22:19:13.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:19:13.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:13.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:13.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:13.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:13.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:13.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:13.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:13.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:13.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:13.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:13.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:13.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:13.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:13.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:19:13.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:13.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:13.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:13.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:13.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:13.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:13.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:13.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:13.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:13.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:19:14.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:14.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:14.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:14.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:14.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:14.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:14.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:19:14.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:14.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:14.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:14.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:14.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:14.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:14.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:14.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:14.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:14.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:14.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:14.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:14.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:14.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:14.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:15.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:15.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:15.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:15.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:15.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:19:15.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:15.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:15.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:19:15.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:15.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:15.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:15.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:15.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:15.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:15.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:15.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:15.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:15.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:15.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:15.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:15.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:15.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:15.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:15.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:19:16.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:16.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:16.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:16.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:16.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:16.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:16.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:16.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:16.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:16.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:19:16.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:16.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:16.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:16.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:16.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:19:16.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:16.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:16.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:16.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:16.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:16.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:16.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:16.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:16.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:16.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:19:17.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:17.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:17.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:17.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:18.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:18.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:18.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:18.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:18.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:18.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:18.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:18.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:18.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:18.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:19:18.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:18.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:18.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:19:18.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:18.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:18.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:18.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:18.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:18.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:18.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:18.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:18.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:18.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:18.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:18.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:18.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:18.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:18.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:19.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:19.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:19.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:19.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:19.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:19.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:19:19.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:19.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:19.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:19.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:19.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:19.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:19.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:19.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:20.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:20.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:20.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:19:20.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:20.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:20.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:20.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:20.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:20.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:20.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:20.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:20.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:20.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:20.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:20.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:20.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:20.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:22.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:22.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:22.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:22.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:22.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:22.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:22.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:22.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:22.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:25.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:25.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:25.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:25.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:19:25.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:25.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:25.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:25.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:25.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:25.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:25.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:25.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:25.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:25.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:26.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:26.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:26.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:26.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:26.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:26.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:19:26.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:26.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:26.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:26.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:26.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:26.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:26.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:26.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:26.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:26.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:26.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:26.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:26.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:26.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:26.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:26.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:26.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:26.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:26.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:26.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:26.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:26.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:26.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:26.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:27.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:27.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:19:27.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:27.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:27.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:27.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:27.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:27.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:27.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:27.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:27.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:27.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:27.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:27.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:27.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:27.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:27.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:27.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:27.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:28.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:28.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:28.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:28.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:28.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:28.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:28.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:28.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:28.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:28.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:28.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:28.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:28.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:28.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:28.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:28.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:28.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:28.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:28.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:28.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:30.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:30.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:30.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:30.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:19:30.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:01' 2024-09-14T22:19:30.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:19:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:19:33.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:33.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:19:33.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:33.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:33.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:33.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:33.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:33.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:33.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:33.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:33.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:33.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:33.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:33.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:33.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:33.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:33.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:33.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:33.694 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:33.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:19:33.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:33.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:19:33.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:33.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:33.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:33.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:33.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:33.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:33.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:34.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:34.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:34.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:34.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:34.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:34.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:34.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:34.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:34.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:34.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:34.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:34.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:34.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:34.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:34.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:34.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:34.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:34.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:34.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:34.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:34.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:34.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:34.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:34.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:34.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:34.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:34.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:34.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:34.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:34.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:19:34.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:19:34.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:34.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:34.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:34.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:34.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:34.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:19:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:19:34.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:34.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:34.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:34.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:19:34.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:19:34.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:34.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:34.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:34.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:19:34.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:19:34.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:19:34.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:34.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:34.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:34.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:34.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:34.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:34.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:34.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:34.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:34.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:34.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:34.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:34.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:34.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:34.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:34.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:34.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:19:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:19:34.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:34.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:34.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:34.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:34.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:19:35.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:35.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:19:35.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:35.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:35.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:35.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:35.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:35.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:35.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:35.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:35.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:35.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:35.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:35.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:35.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:35.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:35.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:35.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:35.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:35.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:35.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:35.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:35.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:35.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:35.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:19:35.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:35.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:35.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:19:35.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:19:35.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:19:35.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:35.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:35.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:35.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:35.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:35.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:35.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:19:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:19:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:19:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:35.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:35.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:35.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:35.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:35.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:35.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:35.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:35.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:35.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:35.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:19:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:19:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:35.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:35.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:35.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:35.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:35.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:35.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:35.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:35.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:35.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:35.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:35.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:35.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:35.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:35.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:35.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:35.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:35.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:35.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:35.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:35.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:19:35.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:19:35.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:35.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:19:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:19:35.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:35.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:19:35.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:35.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:35.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:19:35.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:19:35.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:35.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:35.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:19:35.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:35.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:35.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:35.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:19:35.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:35.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:19:35.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:35.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:19:35.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:19:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:35.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:19:35.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:35.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:35.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:36.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:36.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:36.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:19:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:19:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:19:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:19:36.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:19:36.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:19:36.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:19:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:36.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:19:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:19:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:19:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:36.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:19:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:19:36.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:19:36.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:36.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:36.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:36.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:36.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:36.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:36.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:36.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:36.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:36.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:36.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:36.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:36.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:36.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:36.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:36.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:36.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:36.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:36.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:36.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:36.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:36.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:36.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:36.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:36.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:36.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:36.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:19:36.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:19:36.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:36.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:36.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:19:36.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:19:36.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:36.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:36.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:36.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:36.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:36.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:36.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:19:36.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:19:36.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:36.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:36.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:36.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:19:36.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:36.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:36.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:36.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:36.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:36.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:36.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:36.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:36.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:36.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:36.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:36.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:36.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:36.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:36.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:36.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:36.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:36.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:36.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:36.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:36.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:36.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:36.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:36.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:36.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:36.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:19:36.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:36.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:36.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:19:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:19:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:36.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:19:36.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:36.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:36.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:36.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:36.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:36.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:19:36.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:36.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:36.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:19:36.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:36.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:36.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:19:36.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:36.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:37.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:37.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:37.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:37.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:19:37.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:37.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:37.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:37.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:37.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:37.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:37.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:37.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:37.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:37.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:37.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:37.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:37.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:37.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:37.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:37.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:37.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:37.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:37.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:37.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:37.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:37.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:37.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:37.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:37.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:37.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:37.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:37.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:37.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:19:37.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:19:37.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:37.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:37.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:37.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:37.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:37.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:37.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:37.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:37.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:37.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:37.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:37.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:37.862 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:37.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:37.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:37.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:37.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:37.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:37.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:37.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:19:38.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:38.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:19:38.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:38.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:38.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:38.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:38.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:19:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:38.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:38.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:19:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:38.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:38.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:38.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:38.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:19:38.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:19:38.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:38.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:19:38.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:38.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:38.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:38.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:38.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:19:38.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:38.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:38.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:19:38.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:19:38.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:38.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:38.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:38.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:38.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:38.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:19:38.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:38.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:38.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:38.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:38.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:38.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:19:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:19:38.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:38.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:38.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:38.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:19:38.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:38.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:38.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:19:38.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:38.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:38.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:38.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:38.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:38.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:38.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:38.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:38.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:38.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:19:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:19:38.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:38.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:38.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:38.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:38.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:19:38.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:19:39.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:39.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:39.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:39.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:39.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:39.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:19:39.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:39.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:39.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:19:39.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:39.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:39.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:19:39.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:19:39.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:19:39.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:39.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:19:39.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:19:39.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:39.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:19:39.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:19:39.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:19:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:39.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:39.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:19:39.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:19:31' 2024-09-14T22:19:39.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:19:39.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:19:39.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:19:39.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:19:39.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:19:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:39.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:19:39.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:39.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:19:39.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:19:40.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:19:40.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:19:31' 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:19:31' 2024-09-14T22:19:40.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:19:40.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:19:40.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:19:40.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:19:31' 2024-09-14T22:19:40.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:19:40.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:19:40.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:19:31' 2024-09-14T22:19:40.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:19:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:19:40.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:19:40.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:19:40.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:19:40.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:40.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:19:40.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:19:41.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:19:41.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:19:41.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:19:41.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:19:41.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:19:41.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:19:41.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:20:28.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c67612ae07a555f03e77b4bdd6be1622 2024-09-14T22:20:28.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:20:29.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c67612ae07a555f03e77b4bdd6be1622 != \c\6\7\6\1\2\a\e\0\7\a\5\5\5\f\0\3\e\7\7\b\4\b\d\d\6\b\e\1\6\2\2 ]] 2024-09-14T22:20:29.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=eec00c64b5b54e715185cfc2a50790ad 2024-09-14T22:20:29.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:20:30.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ eec00c64b5b54e715185cfc2a50790ad != \e\e\c\0\0\c\6\4\b\5\b\5\4\e\7\1\5\1\8\5\c\f\c\2\a\5\0\7\9\0\a\d ]] 2024-09-14T22:20:31.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4206ec3974cfe64f5c642f069381af90 2024-09-14T22:20:31.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:20:31.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4206ec3974cfe64f5c642f069381af90 != \4\2\0\6\e\c\3\9\7\4\c\f\e\6\4\f\5\c\6\4\2\f\0\6\9\3\8\1\a\f\9\0 ]] 2024-09-14T22:20:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ee5d627b38be4bd05cd41fddd888d4bf 2024-09-14T22:20:31.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:20:31.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ee5d627b38be4bd05cd41fddd888d4bf != \e\e\5\d\6\2\7\b\3\8\b\e\4\b\d\0\5\c\d\4\1\f\d\d\d\8\8\8\d\4\b\f ]] 2024-09-14T22:20:32.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=646cdbc592bc3f5e9ed9b9ffbbed141b 2024-09-14T22:20:32.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:20:33.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 646cdbc592bc3f5e9ed9b9ffbbed141b != \6\4\6\c\d\b\c\5\9\2\b\c\3\f\5\e\9\e\d\9\b\9\f\f\b\b\e\d\1\4\1\b ]] 2024-09-14T22:20:33.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=f7d8b26df40b873094049d274ee07109 2024-09-14T22:20:33.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:20:33.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c69c65564157e8ce9ec90ee6eb025ae9 2024-09-14T22:20:33.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:20:33.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ f7d8b26df40b873094049d274ee07109 != \f\7\d\8\b\2\6\d\f\4\0\b\8\7\3\0\9\4\0\4\9\d\2\7\4\e\e\0\7\1\0\9 ]] 2024-09-14T22:20:33.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c69c65564157e8ce9ec90ee6eb025ae9 != \c\6\9\c\6\5\5\6\4\1\5\7\e\8\c\e\9\e\c\9\0\e\e\6\e\b\0\2\5\a\e\9 ]] 2024-09-14T22:20:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=096dcc99334f72fb85a439fbc6f7cfd6 2024-09-14T22:20:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:20:33.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4f55314ccfb78bde6aface8f3929f6d2 2024-09-14T22:20:33.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:20:33.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 096dcc99334f72fb85a439fbc6f7cfd6 != \0\9\6\d\c\c\9\9\3\3\4\f\7\2\f\b\8\5\a\4\3\9\f\b\c\6\f\7\c\f\d\6 ]] 2024-09-14T22:20:33.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4f55314ccfb78bde6aface8f3929f6d2 != \4\f\5\5\3\1\4\c\c\f\b\7\8\b\d\e\6\a\f\a\c\e\8\f\3\9\2\9\f\6\d\2 ]] 2024-09-14T22:20:33.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:33.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114344 2024-09-14T22:20:33.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:33.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114346 2024-09-14T22:20:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=2ea50c68f63abd1dc2603756e14e02d9 2024-09-14T22:20:33.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:20:34.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 2ea50c68f63abd1dc2603756e14e02d9 != \2\e\a\5\0\c\6\8\f\6\3\a\b\d\1\d\c\2\6\0\3\7\5\6\e\1\4\e\0\2\d\9 ]] 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114348 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114350 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114352 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114354 2024-09-14T22:20:34.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114356 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114358 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 114360 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:34.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:34.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:20:34.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:34.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:35.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:35.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e74a324e-74ad-4ea2-8368-ec2a50fdacbf 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3303628.8,"bytes_per_snapshot":66072576.0,"last_snapshot_bytes":66072576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352380,"remote_snapshot_timestamp":1726352380,"replay_state":"idle"} 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:35.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:35.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:35.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3303628.8,"bytes_per_snapshot":66072576.0,"last_snapshot_bytes":66072576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352380,"remote_snapshot_timestamp":1726352380,"replay_state":"idle"} 2024-09-14T22:20:35.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:35.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:35.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:35.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:35.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:35.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:35.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:35.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:35.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:35.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e74a324e-74ad-4ea2-8368-ec2a50fdacbfup+replayingreplaying, {"bytes_per_second":3303628.8,"bytes_per_snapshot":66072576.0,"last_snapshot_bytes":66072576,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352380,"remote_snapshot_timestamp":1726352380,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+replayingreplaying, {"bytes_per_second":3428556.8,"bytes_per_snapshot":68571136.0,"last_snapshot_bytes":68571136,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+replayingreplaying, {"bytes_per_second":3235225.6,"bytes_per_snapshot":64704512.0,"last_snapshot_bytes":64704512,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+replayingreplaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+replayingreplaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:35.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:35.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:20:35.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:35.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:20:35.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:35.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:35.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:35.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:20:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:20:35.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:20:35.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:35.527+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a764340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:35.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:35.527+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/e74a324e-74ad-4ea2-8368-ec2a50fdacbf] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:37.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:20:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:20:37.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:37.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:37.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:20:37.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:37.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:20:37.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:37.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:37.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:38.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:38.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:20:38.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedc47b6-9ab5-4504-a0d8-13c19d46a480 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3428556.8,"bytes_per_snapshot":68571136.0,"last_snapshot_bytes":68571136,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:38.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:38.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:38.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3428556.8,"bytes_per_snapshot":68571136.0,"last_snapshot_bytes":68571136,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:38.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:38.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:38.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:38.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:38.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:38.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:38.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:38.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary2fedc47b6-9ab5-4504-a0d8-13c19d46a480up+replayingreplaying, {"bytes_per_second":3428556.8,"bytes_per_snapshot":68571136.0,"last_snapshot_bytes":68571136,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+replayingreplaying, {"bytes_per_second":3235225.6,"bytes_per_snapshot":64704512.0,"last_snapshot_bytes":64704512,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+replayingreplaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+replayingreplaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:38.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:20:38.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:38.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:20:38.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:38.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:38.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:38.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:38.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:38.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:38.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:20:38.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:38.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:38.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:38.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:20:38.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:20:38.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:38.778+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a690340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:38.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:38.778+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/fedc47b6-9ab5-4504-a0d8-13c19d46a480] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:40.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:20:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:20:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:40.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:40.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:20:40.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:40.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:20:40.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:40.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:20:40.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:20:40.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:40.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:40.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:41.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:20:41.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:20:41.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff 2024-09-14T22:20:41.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:41.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3235225.6,"bytes_per_snapshot":64704512.0,"last_snapshot_bytes":64704512,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:41.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:41.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:41.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:41.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:41.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:41.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3235225.6,"bytes_per_snapshot":64704512.0,"last_snapshot_bytes":64704512,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:41.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:41.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:41.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:41.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:41.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:41.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:41.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:41.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:41.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:41.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:41.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:41.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary3c01ce7d2-1dc4-45a6-86f5-0e1474c2eeffup+replayingreplaying, {"bytes_per_second":3235225.6,"bytes_per_snapshot":64704512.0,"last_snapshot_bytes":64704512,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+replayingreplaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+replayingreplaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:41.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:41.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:20:41.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:41.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:20:41.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:41.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:41.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:41.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:41.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:20:41.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:20:41.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:41.783+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ce0340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:41.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:41.783+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/c01ce7d2-1dc4-45a6-86f5-0e1474c2eeff] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:43.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:43.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:20:43.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:43.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:43.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:20:43.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:43.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:43.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:20:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:20:43.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:43.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:43.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:43.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:43.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:44.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:20:44.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:44.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:44.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:20:44.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:20:44.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a960762d-b1ba-48a7-9390-f24aaeabcf4c 2024-09-14T22:20:44.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:44.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"} 2024-09-14T22:20:44.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:44.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:44.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:44.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:44.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:44.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"} 2024-09-14T22:20:44.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:44.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:44.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:44.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:44.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:44.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:44.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:44.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:44.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:44.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:44.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:44.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary4a960762d-b1ba-48a7-9390-f24aaeabcf4cup+replayingreplaying, {"bytes_per_second":3248332.8,"bytes_per_snapshot":64966656.0,"last_snapshot_bytes":64966656,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+replayingreplaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:44.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:44.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:20:44.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:44.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:20:44.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:44.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:44.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:44.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:44.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:44.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:44.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:20:44.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:44.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:44.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:44.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:20:44.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:20:44.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:44.672+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a7eba00 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:44.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:44.672+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/a960762d-b1ba-48a7-9390-f24aaeabcf4c] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:46.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:46.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:20:46.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:46.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:20:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:20:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:20:46.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:46.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:47.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:47.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:47.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:47.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:47.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1649ea4e-8b01-4991-8e1c-3b42fd30d6ad 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:47.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:47.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:47.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:47.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:47.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:47.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:47.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:47.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:47.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:47.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:47.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:47.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:47.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:47.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:47.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary51649ea4e-8b01-4991-8e1c-3b42fd30d6adup+replayingreplaying, {"bytes_per_second":3415244.8,"bytes_per_snapshot":68304896.0,"last_snapshot_bytes":68304896,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:47.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:47.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:20:47.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:47.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:20:47.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:47.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:47.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:47.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:47.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:20:47.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:20:47.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:47.846+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed4820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:47.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:47.846+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/1649ea4e-8b01-4991-8e1c-3b42fd30d6ad] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:49.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:49.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:20:49.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:49.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:20:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:20:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:49.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:20:49.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:49.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:49.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:50.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:50.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:50.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:50.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:20:50.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:20:50.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 02e50316-47d8-485b-967a-18a79aee8039 2024-09-14T22:20:50.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:50.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:50.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:50.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:50.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:50.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:50.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:50.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:50.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:50.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:50.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:50.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:50.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:50.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:50.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:50.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:50.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:50.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:50.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:50.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:50.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary602e50316-47d8-485b-967a-18a79aee8039up+replayingreplaying, {"bytes_per_second":3328409.6,"bytes_per_snapshot":66568192.0,"last_snapshot_bytes":66568192,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:50.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:50.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:20:50.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:50.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:20:50.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:50.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:50.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:50.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:50.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:20:50.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:20:50.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:50.593+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d13380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:50.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:50.593+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/02e50316-47d8-485b-967a-18a79aee8039] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:52.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:52.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:20:52.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:52.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:52.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:20:52.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:52.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:52.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:20:52.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:52.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:20:52.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:52.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:52.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:52.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:53.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:53.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:53.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ebc415a3-82c3-42c3-a68f-f9adfbc77d74 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:53.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:53.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:53.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:53.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"} 2024-09-14T22:20:53.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:53.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:53.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:53.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:53.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:53.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:53.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:53.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:53.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:53.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:53.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary7ebc415a3-82c3-42c3-a68f-f9adfbc77d74up+replayingreplaying, {"bytes_per_second":3142860.8,"bytes_per_snapshot":62857216.0,"last_snapshot_bytes":62857216,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352378,"remote_snapshot_timestamp":1726352378,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:53.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:53.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:20:53.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:20:53.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:53.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:53.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:53.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:53.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:20:53.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:20:53.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:53.604+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a4b81a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:53.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:53.604+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/ebc415a3-82c3-42c3-a68f-f9adfbc77d74] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:55.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:20:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:20:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:55.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:55.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:20:55.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:55.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:55.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:55.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:56.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:20:56.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:56.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:56.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:20:56.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:20:56.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4b8c5a88-e4f0-4350-ad9b-9471db1a9634 2024-09-14T22:20:56.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:56.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:56.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:56.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:56.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:56.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:56.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:56.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:56.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:56.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:56.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:56.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:56.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:56.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:56.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:56.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:56.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:56.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:56.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary84b8c5a88-e4f0-4350-ad9b-9471db1a9634up+replayingreplaying, {"bytes_per_second":3411353.6,"bytes_per_snapshot":68227072.0,"last_snapshot_bytes":68227072,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:56.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:56.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:20:56.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:56.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:20:56.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:56.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:56.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:56.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:56.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:56.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:20:56.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:20:56.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:56.622+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58873c820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:56.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:56.622+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5400 [3/4b8c5a88-e4f0-4350-ad9b-9471db1a9634] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:20:58.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:20:58.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:20:58.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:58.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:58.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:20:58.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:58.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:20:58.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:20:58.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:58.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:20:58.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:20:58.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:20:58.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:20:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:20:59.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:20:59.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83626194-e2fa-4e03-8ce1-b26a348878a5 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:20:31' 2024-09-14T22:20:59.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:20:59.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:20:59.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:20:59.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"} 2024-09-14T22:20:59.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:20:59.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:59.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:20:59.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:59.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:20:59.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:20:59.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:20:59.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:20:59.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:59.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:20:31' 2024-09-14T22:20:59.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:20:59.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:20:31' 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:20:59.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:20:59.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":3300147.2,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31image-primary983626194-e2fa-4e03-8ce1-b26a348878a5up+replayingreplaying, {"bytes_per_second":3352371.2,"bytes_per_snapshot":67047424.0,"last_snapshot_bytes":67047424,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352375,"remote_snapshot_timestamp":1726352375,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:20:31' 2024-09-14T22:20:59.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:20:59.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:20:59.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:20:31' 2024-09-14T22:20:59.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:20:59.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:20:59.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:20:59.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:20:59.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:20:59.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:20:59.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:20:59.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:59.588+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58bc0ab60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:20:59.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:20:59.588+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4f00 [3/83626194-e2fa-4e03-8ce1-b26a348878a5] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:21:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:21:01.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:21:01.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:01.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:01.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:21:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:21:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:21:01.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:01.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:21:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:21:02.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:21:02.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:21:02.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:21:02.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:21:02.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 08daf4bb-ca16-4ce8-95d1-b56978872800 2024-09-14T22:21:02.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:21:02.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"} 2024-09-14T22:21:02.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:21:02.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:21:01' 2024-09-14T22:21:02.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:21:02.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:21:02.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:21:02.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"} 2024-09-14T22:21:02.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:21:02.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:21:02.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:21:02.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:21:02.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:21:02.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:21:01' 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:21:01' 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:21:02.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:21:01' 2024-09-14T22:21:02.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:21:02.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:21:02.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:21:02.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1008daf4bb-ca16-4ce8-95d1-b56978872800up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":66002944.0,"last_snapshot_bytes":66002944,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352377,"remote_snapshot_timestamp":1726352377,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:21:01' 2024-09-14T22:21:02.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:21:02.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:21:02.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:21:01' 2024-09-14T22:21:02.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:21:02.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:21:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:21:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:21:02.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:21:02.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:21:02.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:21:02.614+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588c64b60 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:21:02.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:21:02.614+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5680 [3/08daf4bb-ca16-4ce8-95d1-b56978872800] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:21:04.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:21:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:21:04.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:21:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:04.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T22:21:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:04.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:04.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:04.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:04.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:04.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T22:21:04.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:04.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 32c64d92267f 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.32c64d92267f 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:04 2024 2024-09-14T22:21:04.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:04 2024 2024-09-14T22:21:04.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:04 2024 2024-09-14T22:21:04.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:04.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:04.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:21:04.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T22:21:05.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T22:21:05.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:05.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T22:21:05.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: af965b10-c832-4650-a6ee-95dae8b33101 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:05.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:05.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:05.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:05.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:05.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T22:21:05.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T22:21:05.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:05.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:05.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:05.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:21:05.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T22:21:05.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T22:21:05.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T22:21:05.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T22:21:05.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T22:21:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T22:21:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:05.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T22:21:05.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:05.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2314 2024-09-14T22:21:05.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:05.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T22:21:05.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 32d5240d1002 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.32d5240d1002 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:05 2024 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:05 2024 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:05 2024 2024-09-14T22:21:05.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:05.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:05.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:21:05.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:05.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:05.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:05.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T22:21:06.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T22:21:06.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:06.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T22:21:06.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:06.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:06.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:06.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 58e279bc-28c2-43e8-82de-0156bd5f99ff 2024-09-14T22:21:06.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:06.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:06.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:06.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:06.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:06.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:06.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T22:21:06.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T22:21:06.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:06.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T22:21:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:06.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:06.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:06.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:06.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:06.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T22:21:06.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T22:21:06.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T22:21:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T22:21:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:06.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:06.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:06.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:06.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T22:21:06.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:06.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T22:21:06.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:06.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2316 2024-09-14T22:21:06.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:06.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 32e4b0e58cd8 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.32e4b0e58cd8 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:06 2024 2024-09-14T22:21:06.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:06 2024 2024-09-14T22:21:06.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:06 2024 2024-09-14T22:21:06.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:06.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:06.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:21:06.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:06.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:06.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T22:21:07.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T22:21:07.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:07.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T22:21:07.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:07.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 51992e4d-ceb8-44ad-89e6-bd704a716a52 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:07.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:07.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:07.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:07.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:07.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T22:21:07.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T22:21:07.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:07.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:07.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:07.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T22:21:07.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T22:21:07.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:07.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T22:21:07.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:07.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T22:21:07.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:07.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2318 2024-09-14T22:21:07.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T22:21:07.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:07.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 32f2a63e7eb2 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.32f2a63e7eb2 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:07.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:07 2024 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:07 2024 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:07 2024 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:21:07.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:07.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:07.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:07.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T22:21:08.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T22:21:08.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:08.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T22:21:08.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: e92d45f8-663a-4db6-8470-6380239c9145 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:08.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:08.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:08.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:08.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:08.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T22:21:08.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T22:21:08.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:08.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T22:21:08.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:08.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T22:21:08.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T22:21:08.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:08.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T22:21:08.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T22:21:08.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:08.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T22:21:08.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:08.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:08.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:08.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:08.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:08.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2320 2024-09-14T22:21:08.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:08.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:08.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T22:21:09.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T22:21:09.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 330192710a7a 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.330192710a7a 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:09.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:08 2024 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:08 2024 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:08 2024 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:21:09.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:09.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:09.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:09.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T22:21:09.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T22:21:09.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:09.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T22:21:09.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:09.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:09.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:09.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 3ba482e0-672a-46d5-81f0-7c97599c1467 2024-09-14T22:21:09.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:09.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:09.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:09.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:09.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:09.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:09.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:09.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:09.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T22:21:09.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T22:21:09.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:09.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T22:21:09.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T22:21:09.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:09.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:09.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:09.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:09.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T22:21:09.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:09.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T22:21:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:09.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:09.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2322 2024-09-14T22:21:09.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:09.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:09.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T22:21:09.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2323 2024-09-14T22:21:09.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 33124c6e3f87 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.33124c6e3f87 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:09 2024 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:09 2024 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:09 2024 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:21:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:10.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:10.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:10.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T22:21:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T22:21:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T22:21:10.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 01055c62-6383-428e-a3ea-2f5747f00d5e 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:10.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:10.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:10.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:10.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:10.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:10.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T22:21:10.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T22:21:10.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:10.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T22:21:10.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:10.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:10.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:10.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:10.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:10.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T22:21:10.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:10.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:10.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:10.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:10.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:10.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:10.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2326 2024-09-14T22:21:10.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2325 2024-09-14T22:21:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:10.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:10.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:10.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T22:21:11.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:11.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2328 2024-09-14T22:21:11.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:11.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T22:21:11.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:11.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:11.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:11.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:11.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:11.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 33211be21567 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.33211be21567 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:10 2024 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:10 2024 2024-09-14T22:21:11.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:10 2024 2024-09-14T22:21:11.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:11.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:11.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:21:11.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:11.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:11.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:11.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T22:21:12.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T22:21:12.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:12.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T22:21:12.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:12.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:12.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: dcc8dd4e-feda-47e1-b203-d5e31715e196 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:12.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:12.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:12.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:12.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:12.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T22:21:12.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T22:21:12.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:12.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:12.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:12.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:12.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T22:21:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:12.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T22:21:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:12.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2329 2024-09-14T22:21:12.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2330 2024-09-14T22:21:12.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:12.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T22:21:12.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:12.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 333748f8b044 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.333748f8b044 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:12 2024 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:12 2024 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:12 2024 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:21:12.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:12.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:12.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:12.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T22:21:13.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T22:21:13.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:13.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T22:21:13.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 28602c2b-8355-4ccf-9fe9-dc7c72a3efd6 2024-09-14T22:21:13.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:13.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:13.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:13.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:13.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:13.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:13.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:13.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:13.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T22:21:13.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T22:21:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:13.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T22:21:13.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:13.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T22:21:13.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:13.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:13.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:13.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:13.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T22:21:13.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T22:21:13.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T22:21:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:13.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T22:21:13.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:13.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:13.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T22:21:13.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:13.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T22:21:13.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:13.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2332 2024-09-14T22:21:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2334 2024-09-14T22:21:13.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2333 2024-09-14T22:21:13.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:13.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T22:21:13.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:13.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:13.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:13.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:13.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:13.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:13.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:13.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:13.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:13.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T22:21:13.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 334c8d36b3b2 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.334c8d36b3b2 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:13 2024 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:13 2024 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:13 2024 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:13.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:21:13.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:13.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:13.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:13.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T22:21:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T22:21:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T22:21:14.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:14.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:14.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:14.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 0e36506d-842b-438d-adfb-96606ffcfd25 2024-09-14T22:21:14.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:14.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:14.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:14.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:14.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:14.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:14.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:14.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:14.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T22:21:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T22:21:14.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:14.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:14.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:21:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:21:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:21:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T22:21:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:21:14.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T22:21:14.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:14.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:14.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:14.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2336 2024-09-14T22:21:14.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:21:14.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2337 2024-09-14T22:21:14.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2338 2024-09-14T22:21:14.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:14.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:14.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:14.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T22:21:14.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T22:21:14.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3360aa9ecaee 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3360aa9ecaee 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:21:14 2024 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:21:14 2024 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:21:14 2024 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:21:14.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:21:14.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:21:14.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:21:14.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:21:14.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:21:14.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T22:21:15.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T22:21:15.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:21:15.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T22:21:15.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: f3cbc426-c81d-49ed-88c0-46531cf16364 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:21:15.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:21:15.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:21:15.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:21:15.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:21:15.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T22:21:15.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T22:21:15.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:21:15.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T22:21:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:21:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T22:21:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:15.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 118919 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T22:21:15.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T22:21:15.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:21:15.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:15.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:15.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:15.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2340 2024-09-14T22:21:15.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2341 2024-09-14T22:21:15.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:15.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:16.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:16.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:16.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2342 2024-09-14T22:21:16.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2343 2024-09-14T22:21:16.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:16.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:16.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:16.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:16.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:16.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:16.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:17.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:17.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:17.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:17.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:17.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:17.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:17.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:17.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:17.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:17.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:17.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:17.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:17.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:17.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2346 2024-09-14T22:21:17.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2344 2024-09-14T22:21:17.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2345 2024-09-14T22:21:17.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:18.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:18.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:18.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:18.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:19.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2348 2024-09-14T22:21:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2349 2024-09-14T22:21:19.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:19.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2347 2024-09-14T22:21:19.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:19.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:19.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:19.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:19.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:19.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:19.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:19.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:19.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2350 2024-09-14T22:21:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2351 2024-09-14T22:21:20.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:20.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:21.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:21.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:21.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:21.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:21.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:21.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:21.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:21.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2352 2024-09-14T22:21:21.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:21.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2353 2024-09-14T22:21:21.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:21.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2354 2024-09-14T22:21:21.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2356 2024-09-14T22:21:21.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2355 2024-09-14T22:21:21.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:22.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:22.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:22.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:22.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:22.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:22.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:22.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:22.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:22.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:22.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:22.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:22.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:22.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:22.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:22.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:22.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2357 2024-09-14T22:21:22.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2358 2024-09-14T22:21:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:22.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2359 2024-09-14T22:21:22.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:23.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:23.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:23.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:23.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:23.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:23.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:23.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:23.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2360 2024-09-14T22:21:23.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:23.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2361 2024-09-14T22:21:23.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:24.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:24.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:24.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:24.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:24.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:24.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:24.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:24.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:24.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:24.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:24.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:24.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:24.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2363 2024-09-14T22:21:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2362 2024-09-14T22:21:24.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:24.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:25.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:25.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:25.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:25.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:25.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:25.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2365 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:25.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:25.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:25.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:25.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2364 2024-09-14T22:21:25.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:25.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:25.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:26.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:26.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:26.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:26.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:26.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:26.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:26.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:26.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:26.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:26.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:26.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:26.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:26.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2368 2024-09-14T22:21:26.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2367 2024-09-14T22:21:26.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:26.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:27.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2366 2024-09-14T22:21:27.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:27.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:27.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:27.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:27.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:27.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:27.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:27.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:27.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2370 2024-09-14T22:21:27.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:28.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2369 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:28.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:28.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:28.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:29.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2373 2024-09-14T22:21:29.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:29.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2371 2024-09-14T22:21:29.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:29.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:29.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:29.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:29.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:29.942 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:29.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:29.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:30.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2375 2024-09-14T22:21:30.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:30.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:30.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:30.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2372 2024-09-14T22:21:30.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:30.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2377 2024-09-14T22:21:31.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:31.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:31.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:31.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:31.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:31.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:31.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:31.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2374 2024-09-14T22:21:31.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:31.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:31.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2379 2024-09-14T22:21:31.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2378 2024-09-14T22:21:31.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:32.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:32.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:32.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2376 2024-09-14T22:21:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:32.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2380 2024-09-14T22:21:32.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:32.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:32.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:32.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:32.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:32.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:32.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:33.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:33.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:33.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:33.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:33.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:33.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:33.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:33.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:33.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:33.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:33.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:33.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:33.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2382 2024-09-14T22:21:33.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:34.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:34.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2381 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:34.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:34.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:35.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2384 2024-09-14T22:21:35.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:35.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:35.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:35.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:35.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:35.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:35.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:35.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:35.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:35.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:35.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:35.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:35.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:35.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2383 2024-09-14T22:21:35.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:35.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:35.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:35.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:35.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:35.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:35.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:36.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2388 2024-09-14T22:21:36.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:36.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2385 2024-09-14T22:21:36.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:37.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2389 2024-09-14T22:21:37.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:37.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2386 2024-09-14T22:21:37.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2387 2024-09-14T22:21:37.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:37.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:37.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:37.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:37.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:37.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:37.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:37.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:38.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:38.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2390 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:38.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:39.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:39.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2391 2024-09-14T22:21:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:39.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:39.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2392 2024-09-14T22:21:39.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:39.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:39.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:39.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:39.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:39.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:39.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:39.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2393 2024-09-14T22:21:40.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:40.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2394 2024-09-14T22:21:40.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:40.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:40.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:40.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:40.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:40.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:40.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:40.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:40.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:40.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:40.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:40.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:40.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2395 2024-09-14T22:21:41.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:41.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2396 2024-09-14T22:21:41.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:42.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2397 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:42.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:42.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:42.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2399 2024-09-14T22:21:42.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2398 2024-09-14T22:21:42.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:42.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:42.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:42.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:42.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:42.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:42.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:42.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:42.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:42.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2400 2024-09-14T22:21:42.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:43.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:43.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:44.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:44.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2402 2024-09-14T22:21:44.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2401 2024-09-14T22:21:44.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:44.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:45.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:45.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:45.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:45.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:45.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:45.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:45.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:45.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:45.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2403 2024-09-14T22:21:45.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2404 2024-09-14T22:21:45.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:45.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:45.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:46.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2406 2024-09-14T22:21:46.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2405 2024-09-14T22:21:46.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:47.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:47.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2407 2024-09-14T22:21:47.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2408 2024-09-14T22:21:47.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2409 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:47.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:47.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:47.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:47.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2410 2024-09-14T22:21:47.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:47.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:47.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:48.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2411 2024-09-14T22:21:48.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2412 2024-09-14T22:21:48.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:48.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:48.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:48.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:48.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:48.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:48.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:48.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:48.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:49.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2413 2024-09-14T22:21:49.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2414 2024-09-14T22:21:49.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:49.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:49.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:50.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:50.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:50.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:50.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:50.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:50.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:50.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2416 2024-09-14T22:21:50.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2415 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:50.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:50.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:50.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:50.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:50.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:50.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:50.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:50.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:50.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:50.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:50.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:50.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:50.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:50.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:50.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:51.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:51.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:51.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:51.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:51.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:51.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:51.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:51.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2419 2024-09-14T22:21:51.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2417 2024-09-14T22:21:51.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2418 2024-09-14T22:21:51.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:51.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:51.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:52.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:52.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:53.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2420 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:21:53.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:21:53.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:53.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:21:54.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2422 2024-09-14T22:21:54.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2421 2024-09-14T22:21:54.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:54.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:21:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:21:54.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:54.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:21:54.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:54.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:54.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:21:54.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:21:54.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:54.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:21:54.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:54.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:54.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:21:54.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:21:55.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2424 2024-09-14T22:21:55.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2423 2024-09-14T22:21:55.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:55.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:56.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2425 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:21:56.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:21:56.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2426 2024-09-14T22:21:56.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2427 2024-09-14T22:21:57.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2429 2024-09-14T22:21:57.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2428 2024-09-14T22:21:57.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2430 2024-09-14T22:21:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:57.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:57.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:21:57.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:57.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:57.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:21:57.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:21:57.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:21:58.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2432 2024-09-14T22:21:58.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2431 2024-09-14T22:21:58.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:58.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:21:58.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:21:58.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:58.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:21:58.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:58.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:58.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:21:58.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:21:59.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2434 2024-09-14T22:21:59.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2433 2024-09-14T22:21:59.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:59.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:21:59.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:21:59.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:21:59.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:21:59.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:21:59.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:21:59.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:00.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:00.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:00.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:00.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:00.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:00.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:00.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:00.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:00.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:00.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:00.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:00.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:00.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:00.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:00.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:00.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:00.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:00.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:00.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:00.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:00.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:00.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2436 2024-09-14T22:22:00.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2435 2024-09-14T22:22:00.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:00.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:01.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:01.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:01.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:01.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:02.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2439 2024-09-14T22:22:02.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2438 2024-09-14T22:22:02.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2437 2024-09-14T22:22:02.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:02.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:02.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:02.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:03.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2440 2024-09-14T22:22:03.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2441 2024-09-14T22:22:03.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:03.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:04.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:04.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2442 2024-09-14T22:22:04.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2443 2024-09-14T22:22:05.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:05.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:05.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:05.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:05.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:05.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:05.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:05.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:05.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2444 2024-09-14T22:22:06.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2445 2024-09-14T22:22:06.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:06.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2446 2024-09-14T22:22:06.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:06.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:06.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2448 2024-09-14T22:22:06.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2447 2024-09-14T22:22:06.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2449 2024-09-14T22:22:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:06.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:06.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:07.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:07.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2450 2024-09-14T22:22:07.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:08.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:08.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:08.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:08.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2452 2024-09-14T22:22:08.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:09.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:09.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:09.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:09.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2451 2024-09-14T22:22:09.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2456 2024-09-14T22:22:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:09.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:09.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:09.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:10.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2453 2024-09-14T22:22:10.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:11.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2455 2024-09-14T22:22:11.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:11.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:11.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:11.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:11.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:11.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:11.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2454 2024-09-14T22:22:12.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:12.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:12.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2458 2024-09-14T22:22:12.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2459 2024-09-14T22:22:12.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2457 2024-09-14T22:22:12.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:12.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:12.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:12.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:12.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:12.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:12.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:12.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:13.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2460 2024-09-14T22:22:13.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:13.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2463 2024-09-14T22:22:14.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:14.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2461 2024-09-14T22:22:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:14.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2464 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:15.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:15.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:15.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:15.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:15.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:15.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:15.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:15.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:15.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:15.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:15.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:15.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2462 2024-09-14T22:22:15.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2465 2024-09-14T22:22:15.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2466 2024-09-14T22:22:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:16.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:16.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:16.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2467 2024-09-14T22:22:16.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2468 2024-09-14T22:22:16.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2469 2024-09-14T22:22:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:17.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:17.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:17.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:17.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:17.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:17.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:17.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:17.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:17.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2470 2024-09-14T22:22:17.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:17.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:18.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:18.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:18.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:18.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:18.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:18.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:18.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2472 2024-09-14T22:22:18.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:18.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:18.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:18.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:18.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:18.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:18.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:19.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:19.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:19.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:19.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:19.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:19.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2471 2024-09-14T22:22:19.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:19.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2474 2024-09-14T22:22:19.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:20.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:20.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:20.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2473 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:20.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:20.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:21.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2475 2024-09-14T22:22:21.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2476 2024-09-14T22:22:21.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:21.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:21.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:21.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:21.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:21.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:21.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:21.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:22.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2479 2024-09-14T22:22:22.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2477 2024-09-14T22:22:22.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2478 2024-09-14T22:22:22.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:22.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:22.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:22.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:22.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:23.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2480 2024-09-14T22:22:23.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:23.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:23.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:23.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:23.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:23.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:23.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:23.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2482 2024-09-14T22:22:23.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:24.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2481 2024-09-14T22:22:24.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:24.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2484 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:24.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:24.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:24.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:25.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2483 2024-09-14T22:22:25.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:25.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:25.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2485 2024-09-14T22:22:25.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:25.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2486 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:25.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:25.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:25.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:26.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:26.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:26.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:26.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:26.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:26.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:26.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2489 2024-09-14T22:22:26.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2488 2024-09-14T22:22:26.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2487 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:26.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:26.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:26.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:27.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:27.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:27.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:27.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:27.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:27.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:27.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2490 2024-09-14T22:22:27.937 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:27.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:28.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:28.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2492 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:28.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:28.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:28.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:28.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:28.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:29.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:29.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2491 2024-09-14T22:22:29.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:29.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:29.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:29.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:29.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:29.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:29.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:29.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2496 2024-09-14T22:22:29.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:30.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2493 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:30.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:31.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2494 2024-09-14T22:22:31.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2495 2024-09-14T22:22:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:32.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:32.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:32.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:32.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:32.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2498 2024-09-14T22:22:32.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2497 2024-09-14T22:22:32.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2499 2024-09-14T22:22:32.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2500 2024-09-14T22:22:32.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:32.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:32.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:32.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:33.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2502 2024-09-14T22:22:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:33.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:33.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:33.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:34.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2501 2024-09-14T22:22:34.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:34.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2504 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:34.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:35.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:35.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2503 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:35.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:35.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:35.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:35.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:35.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:35.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:35.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:35.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:35.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2506 2024-09-14T22:22:35.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2505 2024-09-14T22:22:35.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:35.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:36.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2509 2024-09-14T22:22:36.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2507 2024-09-14T22:22:36.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2508 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:36.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:36.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:36.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:36.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:37.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:37.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:37.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:37.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:37.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:37.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:37.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:38.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2510 2024-09-14T22:22:38.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2512 2024-09-14T22:22:38.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:38.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:38.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:38.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:39.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2511 2024-09-14T22:22:39.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:39.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:39.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:39.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:39.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:39.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:39.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:39.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:39.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2514 2024-09-14T22:22:40.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:40.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2513 2024-09-14T22:22:40.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:41.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:41.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:41.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:41.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:41.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:41.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:41.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:41.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:41.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:41.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:41.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:41.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:41.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2515 2024-09-14T22:22:41.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2516 2024-09-14T22:22:42.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2517 2024-09-14T22:22:42.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2519 2024-09-14T22:22:42.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2518 2024-09-14T22:22:42.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2520 2024-09-14T22:22:42.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:42.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:43.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:43.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2522 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:43.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:44.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:44.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2521 2024-09-14T22:22:44.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:45.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2524 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:45.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:45.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:45.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:45.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:45.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:45.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:45.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:45.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:45.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:45.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:45.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2523 2024-09-14T22:22:45.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:45.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:45.964 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:45.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:46.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2526 2024-09-14T22:22:46.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2525 2024-09-14T22:22:46.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:46.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:47.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2528 2024-09-14T22:22:47.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2527 2024-09-14T22:22:47.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:47.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:47.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:47.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:47.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:47.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:47.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2529 2024-09-14T22:22:47.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:47.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:47.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:48.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:48.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:48.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2530 2024-09-14T22:22:48.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:48.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2532 2024-09-14T22:22:48.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:48.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:48.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:48.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:48.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:48.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:48.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:49.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:49.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:49.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2531 2024-09-14T22:22:49.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:49.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2534 2024-09-14T22:22:49.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:50.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:50.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:50.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:50.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:50.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:50.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2533 2024-09-14T22:22:50.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:51.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2535 2024-09-14T22:22:51.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2536 2024-09-14T22:22:51.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:51.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:51.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:51.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:51.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:51.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:51.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:51.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:51.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:51.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:51.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:51.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:51.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:51.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:52.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2538 2024-09-14T22:22:52.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2539 2024-09-14T22:22:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2537 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:52.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:52.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:52.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:52.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:52.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:52.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2540 2024-09-14T22:22:53.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:53.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:53.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2542 2024-09-14T22:22:53.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:54.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2541 2024-09-14T22:22:54.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:54.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:54.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:54.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2544 2024-09-14T22:22:54.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:55.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2543 2024-09-14T22:22:55.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:55.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2545 2024-09-14T22:22:55.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:55.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:55.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2546 2024-09-14T22:22:55.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:55.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:55.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:55.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:55.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:55.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:55.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:55.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:56.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:56.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:22:56.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:56.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:56.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:22:56.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:22:56.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2548 2024-09-14T22:22:56.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2547 2024-09-14T22:22:56.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2549 2024-09-14T22:22:56.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:56.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:22:56.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:22:56.945 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:22:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:57.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:22:57.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:22:57.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:57.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:22:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:22:57.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:22:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:22:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:58.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:22:58.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:22:58.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2550 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:22:58.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:22:58.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:22:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:22:58.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2552 2024-09-14T22:22:59.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:59.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2551 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:22:59.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:22:59.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:22:59.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2553 2024-09-14T22:22:59.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:59.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:22:59.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:22:59.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:22:59.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:22:59.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:22:59.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:22:59.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:22:59.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2554 2024-09-14T22:23:00.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:00.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2556 2024-09-14T22:23:00.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2555 2024-09-14T22:23:00.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:00.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:01.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:01.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:01.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:01.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:01.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:01.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:02.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:02.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2558 2024-09-14T22:23:02.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2557 2024-09-14T22:23:02.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2559 2024-09-14T22:23:02.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:02.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:02.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:02.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:02.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2560 2024-09-14T22:23:02.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:02.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:02.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:03.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:03.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:03.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2562 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:03.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:03.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:04.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2561 2024-09-14T22:23:04.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:05.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:23:05.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:23:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:05.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:05.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:05.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:05.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:05.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:05.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2563 2024-09-14T22:23:05.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2564 2024-09-14T22:23:05.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:05.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:05.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:06.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2565 2024-09-14T22:23:06.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2566 2024-09-14T22:23:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:06.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:06.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:07.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2568 2024-09-14T22:23:07.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2569 2024-09-14T22:23:07.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2567 2024-09-14T22:23:07.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:07.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:07.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:07.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:08.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2570 2024-09-14T22:23:08.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:08.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:08.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2572 2024-09-14T22:23:08.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:08.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:08.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:08.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:08.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:08.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:09.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:09.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2571 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:09.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:09.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:09.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:10.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2574 2024-09-14T22:23:10.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2573 2024-09-14T22:23:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:10.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:10.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:10.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:10.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:10.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:23:10.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:10.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:10.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:23:10.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:23:10.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:10.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:10.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:10.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:10.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:10.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:11.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2575 2024-09-14T22:23:11.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:11.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2576 2024-09-14T22:23:11.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:11.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:11.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:11.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:12.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:12.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:12.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:12.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:12.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:12.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:12.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2577 2024-09-14T22:23:12.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2579 2024-09-14T22:23:12.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2578 2024-09-14T22:23:12.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:12.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:12.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:12.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2580 2024-09-14T22:23:12.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:13.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:13.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:13.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:13.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:13.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:13.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:13.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:14.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2582 2024-09-14T22:23:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:14.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:14.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:14.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2581 2024-09-14T22:23:15.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:15.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:15.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:15.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:23:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:23:15.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2583 2024-09-14T22:23:16.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2584 2024-09-14T22:23:16.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:16.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:16.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2586 2024-09-14T22:23:16.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2585 2024-09-14T22:23:17.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:17.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:17.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:17.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2587 2024-09-14T22:23:17.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2588 2024-09-14T22:23:17.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2589 2024-09-14T22:23:17.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:17.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:17.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:18.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:18.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:18.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:18.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:18.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:18.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:18.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2590 2024-09-14T22:23:18.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:18.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2592 2024-09-14T22:23:18.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:19.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:19.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:19.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2591 2024-09-14T22:23:19.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:19.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2593 2024-09-14T22:23:19.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2594 2024-09-14T22:23:19.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:19.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:20.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:20.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:20.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:20.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:20.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:20.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:20.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:20.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:20.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:23:20.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:23:20.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:20.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:20.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:20.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:20.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:20.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2596 2024-09-14T22:23:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2595 2024-09-14T22:23:21.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:21.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:21.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:21.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:21.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:21.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:21.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:21.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:22.876 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2597 2024-09-14T22:23:22.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:22.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2598 2024-09-14T22:23:22.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2599 2024-09-14T22:23:22.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:22.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:22.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:22.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:22.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:22.926 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:22.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:22.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:22.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2600 2024-09-14T22:23:22.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2602 2024-09-14T22:23:23.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:24.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:24.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:24.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:24.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:24.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:24.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:24.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:24.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2601 2024-09-14T22:23:24.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:25.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2604 2024-09-14T22:23:25.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2603 2024-09-14T22:23:25.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:25.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:25.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:23:25.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:25.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:23:25.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:23:26.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2605 2024-09-14T22:23:26.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2606 2024-09-14T22:23:26.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:26.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:26.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:23:26.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:26.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:26.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:23:26.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:23:26.936 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:26.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2609 2024-09-14T22:23:26.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2607 2024-09-14T22:23:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2608 2024-09-14T22:23:26.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:26.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:27.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:27.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:27.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:27.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:27.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:27.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:28.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2610 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:23:28.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:23:28.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:28.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:28.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2612 2024-09-14T22:23:28.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:29.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2611 2024-09-14T22:23:29.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:29.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:29.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2614 2024-09-14T22:23:29.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2613 2024-09-14T22:23:29.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:29.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:23:29.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:29.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:29.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:23:29.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:23:29.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:29.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:29.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:29.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119051 2024-09-14T22:23:29.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:29.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:23:29.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:29.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:29.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:23:29.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:29.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:30.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2615 2024-09-14T22:23:30.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2616 2024-09-14T22:23:30.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:30.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:31.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:31.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119183 2024-09-14T22:23:31.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:31.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:23:31.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:31.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:31.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:23:31.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:23:32.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2618 2024-09-14T22:23:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2617 2024-09-14T22:23:32.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:32.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:32.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:32.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119315 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:23:32.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:23:32.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:32.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119467 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:23:33.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:23:33.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:33.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119620 2024-09-14T22:23:34.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2619 2024-09-14T22:23:34.946 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:23:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:23:35.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:35.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119794 2024-09-14T22:23:35.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2620 2024-09-14T22:23:35.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2621 2024-09-14T22:23:36.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:36.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2622 2024-09-14T22:23:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:23:37.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:37.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119967 2024-09-14T22:23:38.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:38.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 120141 2024-09-14T22:23:39.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:23:39.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 120295 2024-09-14T22:23:39.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:23:39.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:23:39.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 118920 2024-09-14T22:26:05.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:05.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:05.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:05.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119052 2024-09-14T22:26:06.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:06.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:06.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:06.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119184 2024-09-14T22:26:07.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:07.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:07.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:07.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119316 2024-09-14T22:26:08.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:08.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:08.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:08.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119468 2024-09-14T22:26:09.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:09.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:09.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:09.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119621 2024-09-14T22:26:10.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:10.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:10.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:10.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119795 2024-09-14T22:26:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:12.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:12.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 119968 2024-09-14T22:26:13.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:13.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:13.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:13.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 120142 2024-09-14T22:26:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:14.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:14.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:26:14.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 120296 2024-09-14T22:26:15.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:26:15.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:26:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:26:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:26:15.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:26:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:26:15.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:26:15.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:26:15.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:26:15.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:26:15.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:26:15.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:26:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126229 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:26:15.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:26:16.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:26:16.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:26:16.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:26:16.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:26:16.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:26:16.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:26:16.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:16.899 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:26:17.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:26:17.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:17.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:26:17.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:26:17.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:26:17.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:08.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=f328476e1245deb507e7fd5716f10269 2024-09-14T22:27:08.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:27:09.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:27:09.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:09.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:09.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:09.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:27:09.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4bc82c59512d1338fe8ec7bb78277246 2024-09-14T22:27:09.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:27:09.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4c7b9ad524f5fb43d31d48081e6f42d6 2024-09-14T22:27:09.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:27:09.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:27:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:10.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:10.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:10.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:27:10.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:10.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:10.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:10.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:27:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:27:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:27:10.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=d0cf7525c0bb6a92da1366d4c52ce16d 2024-09-14T22:27:10.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:27:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:27:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:10.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:27:10.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:10.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:11.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:11.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:11.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:27:11.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=9579abcc931b921b67c3b024bb8faa1d 2024-09-14T22:27:11.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:11.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:11.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:11.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:11.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=9d05b7966bc069e8d32a1f64a03ed9fb 2024-09-14T22:27:11.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:27:11.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:27:11.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:11.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:11.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:11.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:27:11.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:27:11.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:11.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:11.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:11.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:27:12.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:12.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:12.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:12.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:12.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:27:12.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:12.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:12.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:12.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:12.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:12.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:12.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:12.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:12.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:12.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:12.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:12.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:12.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:12.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:12.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:12.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=250b1f6d711ba89a5d9e2b54fec6d16f 2024-09-14T22:27:12.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:27:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:27:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:12.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:12.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:27:12.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:13.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:13.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:13.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:13.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:13.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:13.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:13.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:13.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:13.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:13.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:13.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:13.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:13.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:13.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:13.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:13.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:13.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:13.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:27:13.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c80d3ec792c512f3bbbd728ce43a726f 2024-09-14T22:27:13.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:13.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:13.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:13.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:13.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:13.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:13.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:13.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:13.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:13.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:13.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:27:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:13.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:13.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:13.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:27:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:14.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:14.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:14.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:14.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:14.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:27:14.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:14.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:14.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:14.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:14.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:27:14.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:14.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:14.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:14.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:14.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:14.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:14.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:14.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:14.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:14.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:14.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:14.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:14.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:14.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:14.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:27:14.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:14.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:14.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:27:14.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:14.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:14.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:14.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=edf0c74418c54e7637c93f815e47154f 2024-09-14T22:27:14.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:27:14.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:27:14.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:14.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:27:14.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=6324e8693bb890f010216f5e6e911813 2024-09-14T22:27:14.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:27:14.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:27:14.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:27:15.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:15.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:15.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:15.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:15.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:15.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:15.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:15.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:15.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:15.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:15.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:27:15.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:15.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:15.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:15.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:15.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:15.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:15.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:15.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:15.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:15.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:15.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:15.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:15.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:15.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:15.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:16.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:16.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:16.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:16.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:16.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:27:16.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:16.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:16.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:27:16.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:27:16.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:16.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:16.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:16.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:16.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:16.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:16.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:16.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:16.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:16.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:16.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:16.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:16.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:16.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:27:16.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:16.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:16.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:16.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:16.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:27:16.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:16.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:16.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:16.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:16.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:16.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:16.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:17.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:27:17.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:17.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:17.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:17.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:17.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:17.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:17.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:27:17.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:27:17.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:27:17.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:17.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:17.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:17.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:17.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:17.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:17.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:17.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:17.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:17.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:17.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:17.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:17.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:17.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:17.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:27:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:17.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:17.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:17.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:18.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:18.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:27:18.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:18.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:18.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:18.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:18.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:18.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:18.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:18.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:18.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:18.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:27:18.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:18.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:27:18.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:18.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:18.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:18.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:18.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:18.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:19.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:27:19.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:19.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:19.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:19.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:19.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:19.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:19.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:19.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:19.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:27:19.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:27:19.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:19.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:19.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:19.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:19.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:27:19.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:19.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:19.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:19.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:19.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:19.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:19.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:27:19.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:19.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:19.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:19.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:19.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:19.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:20.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:27:20.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:20.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:20.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:20.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:20.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:20.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:20.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:20.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:20.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:20.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:27:20.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:20.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:20.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:20.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:20.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:20.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:20.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:20.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:20.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:20.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:20.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:20.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:22.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:22.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:22.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:27:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:22.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:22.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:22.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:23.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:23.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:27:23.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:23.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:23.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:23.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:23.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:23.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:23.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:23.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:23.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:23.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:23.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:23.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:25.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:27:25.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:25.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:25.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:25.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:25.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:25.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:25.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:25.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:25.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:25.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:26.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:26.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:26.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:26.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:26.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:26.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:26.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:27:26.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:26.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:26.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:26.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:26.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:26.423 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:26.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:26.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:26.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:27.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:27.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:27.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:27.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:27.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:27.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:27.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:27.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:27.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:27.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:27.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:27.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:27.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:27.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:27.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:27.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:27.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:27.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:27.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:27.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:27.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:27.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:27.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:27.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:27.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:27.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:27.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:28.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:28.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:28.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:28.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:28.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:28.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:28.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:28.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:28.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:28.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:28.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:28.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:28.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:27:28.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:28.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:28.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:28.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:28.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:28.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:28.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:28.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:28.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:28.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:28.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:28.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:28.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:28.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:28.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:28.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:28.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:28.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:28.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:28.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:30.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:30.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:30.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:30.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:30.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:30.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:30.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:01' 2024-09-14T22:27:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:30.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:27:30.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:30.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:31.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:31.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:31.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:27:31.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:27:31.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:31.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:31.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:31.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:31.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:31.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:31.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:31.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:31.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:31.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:31.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:31.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:31.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:31.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:31.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:31.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:31.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:31.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:31.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:31.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:31.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:31.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:31.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:31.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:31.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:31.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:31.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:31.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:31.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:31.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:31.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:31.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:31.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:31.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:31.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:31.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:27:31.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:31.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:31.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:27:31.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:31.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:31.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:27:31.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:27:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:31.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:31.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:31.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:31.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:31.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:31.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:31.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:27:31.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:31.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:31.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:32.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:27:32.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:32.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:32.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:32.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:32.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:32.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:32.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:32.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:32.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:32.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:32.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:32.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:32.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:32.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:32.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:32.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:32.678 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:32.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:32.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:32.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:32.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:32.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:32.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:32.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:32.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:32.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:27:32.820 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:27:32.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:32.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:27:32.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:27:32.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:32.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:32.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:32.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:32.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:32.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:32.833 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:27:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:27:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:32.834 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:27:33.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:33.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:33.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:33.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:33.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:27:33.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:33.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:33.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:27:33.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:33.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:27:33.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:27:33.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:27:33.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:27:33.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:33.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:27:33.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:33.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:33.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:33.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:33.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:33.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:33.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:33.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:33.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:33.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:33.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:33.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:33.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:33.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:33.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:33.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:33.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:33.555 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:33.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:33.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:27:33.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:27:33.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:33.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:33.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:33.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:27:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:33.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:33.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:34.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:27:34.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.428 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:27:34.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:34.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:34.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:34.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:34.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:34.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:34.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:34.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:34.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:34.519 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:34.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:34.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:34.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:34.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:34.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:34.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:34.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.525 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:34.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:34.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:34.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:34.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:34.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:34.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:34.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:34.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:34.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:34.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:34.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:34.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:27:34.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:34.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:34.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:27:34.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:27:34.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:34.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:27:34.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:34.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:27:34.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:27:34.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:34.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:34.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:34.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:34.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:34.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:34.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:34.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:27:34.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:34.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:34.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:34.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:34.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:34.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:34.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:34.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:34.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:34.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:34.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:34.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:34.785 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:34.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:27:34.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:34.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:27:34.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:34.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:34.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:34.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:27:35.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:35.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:27:35.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:27:35.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:27:35.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:27:35.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:27:35.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:35.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:35.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:35.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:35.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:35.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:35.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:35.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:35.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:35.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:35.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:35.531 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:35.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:35.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:35.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:35.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:35.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:35.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:35.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:35.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:35.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:35.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:35.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:35.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:35.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:35.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:35.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:35.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:35.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:27:35.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:27:35.679 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:35.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:35.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:35.685 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:27:35.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:27:35.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:27:35.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:35.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:35.738 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:27:35.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:27:35.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:35.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:35.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:35.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:35.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:35.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:35.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:35.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:27:35.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:27:35.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:35.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:35.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:35.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:35.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:35.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:35.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:35.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:35.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:35.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:27:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:27:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:35.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:35.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:35.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:35.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:35.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:35.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:35.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:35.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:35.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:35.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:35.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:35.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:35.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:35.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:35.817 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:35.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:35.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:35.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:35.822 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:35.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:35.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:35.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:35.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:27:35.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:35.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:27:35.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:35.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:35.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:27:36.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:27:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:36.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:27:36.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:36.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:36.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:27:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:27:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:27:36.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:36.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:36.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:36.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:27:36.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:36.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:36.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:27:36.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:36.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:36.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:27:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:36.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:36.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:36.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:36.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:36.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:36.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:36.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:36.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:36.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:36.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:36.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:36.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:36.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:36.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:36.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:36.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:36.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:36.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:36.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:36.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:36.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:36.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:27:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:27:36.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:27:36.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:27:36.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:27:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:36.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:27:36.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:36.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:36.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:27:36.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:27:36.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:36.742 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:36.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:36.749 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:27:36.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:36.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:27:36.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:36.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:36.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:36.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:36.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:36.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:36.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:36.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:36.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:27:36.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:27:36.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:36.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:36.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:36.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:36.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:36.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:36.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:36.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:36.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:36.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:36.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:36.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:36.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:36.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:36.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:37.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:37.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:37.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:27:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:37.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:27:37.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:37.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:37.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:37.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:27:37.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:37.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:37.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:27:37.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:37.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:27:37.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:37.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:37.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:37.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:37.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:37.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:37.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:27:37.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:37.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:37.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:27:37.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:37.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:27:37.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:37.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:37.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:37.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:37.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:27:37.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:37.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:37.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:27:37.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:27:37.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:27:37.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:27:37.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:37.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:27:37.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:37.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:37.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:27:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:27:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:37.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:37.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:37.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:27:37.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:27:37.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:27:37.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:37.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:37.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:37.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:37.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:37.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:37.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:37.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:37.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:37.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:37.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:37.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:37.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:37.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:37.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:37.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:38.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:38.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:38.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:38.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:38.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:38.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:38.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:38.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:38.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:38.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:38.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:38.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:38.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:38.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:38.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:38.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:38.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:38.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:38.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:38.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:38.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:38.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:38.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:38.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:38.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:38.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:38.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:38.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:38.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:38.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:38.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:38.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:27:38.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:38.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:38.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:27:38.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:27:38.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:38.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:38.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:27:38.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:38.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:38.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:38.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:27:38.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:38.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:27:38.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:38.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:38.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:38.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:38.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:38.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:38.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:38.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:38.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:38.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:38.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:38.647 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:38.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:38.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:38.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:38.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:38.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:38.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:27:38.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:38.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:27:38.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:38.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:38.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:38.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:27:38.915 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:27:39.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:39.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:39.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:39.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:39.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:27:39.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:39.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:27:39.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:27:39.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:39.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:27:39.832 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:27:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:27:39.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:27:39.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:27:39.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:27:39.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:39.925 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:39.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:27:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:27:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:27:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:27:40.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:27:40.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:27:40.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:27:31' 2024-09-14T22:27:40.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:27:40.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:27:40.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:27:40.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:27:40.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:27:40.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:40.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:27:40.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:40.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:27:40.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:27:40.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:27:40.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:27:40.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:40.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:27:31' 2024-09-14T22:27:40.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:40.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:40.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:40.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:27:40.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:27:31' 2024-09-14T22:27:40.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:27:40.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:27:40.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:27:40.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:27:31' 2024-09-14T22:27:40.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:27:40.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:27:40.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:27:31' 2024-09-14T22:27:40.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:27:40.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:27:40.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:27:40.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:27:40.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:27:40.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:40.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:27:40.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:27:40.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:27:40.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:27:40.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:27:40.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:27:40.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:27:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:27:41.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:27:41.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:27:41.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:27:41.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:27:41.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:27:41.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:28:23.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=edf0c74418c54e7637c93f815e47154f 2024-09-14T22:28:23.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:28:23.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ edf0c74418c54e7637c93f815e47154f != \e\d\f\0\c\7\4\4\1\8\c\5\4\e\7\6\3\7\c\9\3\f\8\1\5\e\4\7\1\5\4\f ]] 2024-09-14T22:28:26.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=6324e8693bb890f010216f5e6e911813 2024-09-14T22:28:26.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:28:26.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 6324e8693bb890f010216f5e6e911813 != \6\3\2\4\e\8\6\9\3\b\b\8\9\0\f\0\1\0\2\1\6\f\5\e\6\e\9\1\1\8\1\3 ]] 2024-09-14T22:28:29.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4bc82c59512d1338fe8ec7bb78277246 2024-09-14T22:28:29.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:28:29.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4bc82c59512d1338fe8ec7bb78277246 != \4\b\c\8\2\c\5\9\5\1\2\d\1\3\3\8\f\e\8\e\c\7\b\b\7\8\2\7\7\2\4\6 ]] 2024-09-14T22:28:30.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4c7b9ad524f5fb43d31d48081e6f42d6 2024-09-14T22:28:30.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:28:30.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=d0cf7525c0bb6a92da1366d4c52ce16d 2024-09-14T22:28:30.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:28:31.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=f328476e1245deb507e7fd5716f10269 2024-09-14T22:28:31.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:28:31.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4c7b9ad524f5fb43d31d48081e6f42d6 != \4\c\7\b\9\a\d\5\2\4\f\5\f\b\4\3\d\3\1\d\4\8\0\8\1\e\6\f\4\2\d\6 ]] 2024-09-14T22:28:31.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ d0cf7525c0bb6a92da1366d4c52ce16d != \d\0\c\f\7\5\2\5\c\0\b\b\6\a\9\2\d\a\1\3\6\6\d\4\c\5\2\c\e\1\6\d ]] 2024-09-14T22:28:31.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ f328476e1245deb507e7fd5716f10269 != \f\3\2\8\4\7\6\e\1\2\4\5\d\e\b\5\0\7\e\7\f\d\5\7\1\6\f\1\0\2\6\9 ]] 2024-09-14T22:28:31.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=9579abcc931b921b67c3b024bb8faa1d 2024-09-14T22:28:31.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:28:32.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=9d05b7966bc069e8d32a1f64a03ed9fb 2024-09-14T22:28:32.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:28:32.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 9579abcc931b921b67c3b024bb8faa1d != \9\5\7\9\a\b\c\c\9\3\1\b\9\2\1\b\6\7\c\3\b\0\2\4\b\b\8\f\a\a\1\d ]] 2024-09-14T22:28:32.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 9d05b7966bc069e8d32a1f64a03ed9fb != \9\d\0\5\b\7\9\6\6\b\c\0\6\9\e\8\d\3\2\a\1\f\6\4\a\0\3\e\d\9\f\b ]] 2024-09-14T22:28:32.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:32.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126230 2024-09-14T22:28:32.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=250b1f6d711ba89a5d9e2b54fec6d16f 2024-09-14T22:28:32.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:28:32.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 250b1f6d711ba89a5d9e2b54fec6d16f != \2\5\0\b\1\f\6\d\7\1\1\b\a\8\9\a\5\d\9\e\2\b\5\4\f\e\c\6\d\1\6\f ]] 2024-09-14T22:28:32.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:32.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126232 2024-09-14T22:28:32.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:32.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126234 2024-09-14T22:28:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c80d3ec792c512f3bbbd728ce43a726f 2024-09-14T22:28:33.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:28:33.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c80d3ec792c512f3bbbd728ce43a726f != \c\8\0\d\3\e\c\7\9\2\c\5\1\2\f\3\b\b\b\d\7\2\8\c\e\4\3\a\7\2\6\f ]] 2024-09-14T22:28:33.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126236 2024-09-14T22:28:33.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126238 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126240 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126242 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126244 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 126246 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:33.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:34.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:28:34.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:34.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: cf04293f-639e-4eb7-8713-86b0d1244cc6 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3135078.4,"bytes_per_snapshot":62701568.0,"last_snapshot_bytes":62701568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"} 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:34.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:34.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3135078.4,"bytes_per_snapshot":62701568.0,"last_snapshot_bytes":62701568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"} 2024-09-14T22:28:34.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:34.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:34.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:34.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:34.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:34.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:34.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:34.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:34.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:34.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:35.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1cf04293f-639e-4eb7-8713-86b0d1244cc6up+replayingreplaying, {"bytes_per_second":3135078.4,"bytes_per_snapshot":62701568.0,"last_snapshot_bytes":62701568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+replayingreplaying, {"bytes_per_second":3274137.6,"bytes_per_snapshot":65482752.0,"last_snapshot_bytes":65482752,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+replayingreplaying, {"bytes_per_second":3168870.4,"bytes_per_snapshot":63377408.0,"last_snapshot_bytes":63377408,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+replayingreplaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+replayingreplaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:35.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:35.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:28:35.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:35.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:28:35.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:35.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:35.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:35.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:28:35.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:28:35.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:35.258+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58b79e1a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:35.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:35.258+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4f00 [3/cf04293f-639e-4eb7-8713-86b0d1244cc6] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:36.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:36.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:36.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:28:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:36.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:37.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:28:37.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:37.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:28:37.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:28:37.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 51d7dd73-52c7-454e-8d29-7dac67754d04 2024-09-14T22:28:37.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:37.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3274137.6,"bytes_per_snapshot":65482752.0,"last_snapshot_bytes":65482752,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"} 2024-09-14T22:28:37.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:37.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:37.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:37.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:37.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:37.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3274137.6,"bytes_per_snapshot":65482752.0,"last_snapshot_bytes":65482752,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"} 2024-09-14T22:28:37.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:37.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:37.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:37.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:37.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:37.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:37.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:37.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:37.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:37.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:37.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:38.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary251d7dd73-52c7-454e-8d29-7dac67754d04up+replayingreplaying, {"bytes_per_second":3274137.6,"bytes_per_snapshot":65482752.0,"last_snapshot_bytes":65482752,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352859,"remote_snapshot_timestamp":1726352859,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+replayingreplaying, {"bytes_per_second":3168870.4,"bytes_per_snapshot":63377408.0,"last_snapshot_bytes":63377408,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+replayingreplaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+replayingreplaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:38.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:38.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:28:38.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:38.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:28:38.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:38.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:38.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:28:38.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:28:38.249 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:38.247+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b591c7a680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:38.249 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:38.247+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5680 [3/51d7dd73-52c7-454e-8d29-7dac67754d04] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:39.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:28:39.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:28:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:39.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:28:39.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:39.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:39.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:39.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:39.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:40.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:28:40.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:40.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:28:40.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:28:40.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: c9db65bc-c49f-4d1a-8cc8-876f1d56b153 2024-09-14T22:28:40.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:40.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3168870.4,"bytes_per_snapshot":63377408.0,"last_snapshot_bytes":63377408,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"} 2024-09-14T22:28:40.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:40.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:40.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:40.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:40.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:40.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3168870.4,"bytes_per_snapshot":63377408.0,"last_snapshot_bytes":63377408,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"} 2024-09-14T22:28:40.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:40.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:40.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:40.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:40.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:40.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:40.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:40.901 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:40.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:40.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:40.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:40.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:41.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary3c9db65bc-c49f-4d1a-8cc8-876f1d56b153up+replayingreplaying, {"bytes_per_second":3168870.4,"bytes_per_snapshot":63377408.0,"last_snapshot_bytes":63377408,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+replayingreplaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+replayingreplaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:41.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:41.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:28:41.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:41.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:28:41.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:41.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:41.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:41.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:41.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:41.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:28:41.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:28:41.271 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:41.269+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d36ea0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:41.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:41.269+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/c9db65bc-c49f-4d1a-8cc8-876f1d56b153] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:42.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:28:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:28:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:28:42.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:42.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:28:42.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:42.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:42.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:43.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:43.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:43.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0e100d45-ad69-43c2-ace3-971ffae81391 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"} 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:43.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:43.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:43.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"} 2024-09-14T22:28:43.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:43.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:43.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:43.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:43.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:43.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:43.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:43.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:43.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:43.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:44.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary40e100d45-ad69-43c2-ace3-971ffae81391up+replayingreplaying, {"bytes_per_second":3339878.4,"bytes_per_snapshot":66797568.0,"last_snapshot_bytes":66797568,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352861,"remote_snapshot_timestamp":1726352861,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+replayingreplaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:44.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:44.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:28:44.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:44.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:28:44.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:44.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:44.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:44.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:44.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:28:44.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:28:44.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:44.296+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58bc0b1e0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:44.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:44.296+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5400 [3/0e100d45-ad69-43c2-ace3-971ffae81391] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:46.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:46.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:46.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:28:46.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:46.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:28:46.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:46.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:47.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:28:47.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:47.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:47.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:28:47.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 83ca4866-4277-4564-88b1-ff8dc0e7d788 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"} 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:47.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:47.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:47.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:47.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"} 2024-09-14T22:28:47.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:47.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:47.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:47.360 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:47.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:47.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:47.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:47.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:47.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:47.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:47.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:47.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:47.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:47.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary583ca4866-4277-4564-88b1-ff8dc0e7d788up+replayingreplaying, {"bytes_per_second":3433267.2,"bytes_per_snapshot":68665344.0,"last_snapshot_bytes":68665344,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:47.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:47.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:28:47.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:47.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:28:47.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:47.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:47.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:47.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:47.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:28:47.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:28:47.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:47.704+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a6909c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:47.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:47.704+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/83ca4866-4277-4564-88b1-ff8dc0e7d788] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:49.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:49.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:28:49.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:49.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:49.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:28:49.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:49.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:49.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:28:49.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:49.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:49.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:50.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:50.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:50.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:28:50.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:28:50.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: ac9631b8-402a-4ace-b85a-b152976ef571 2024-09-14T22:28:50.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:50.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"} 2024-09-14T22:28:50.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:50.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:50.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:50.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:50.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:50.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"} 2024-09-14T22:28:50.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:50.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:50.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:50.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:50.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:50.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:50.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:50.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:50.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:50.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:50.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:50.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary6ac9631b8-402a-4ace-b85a-b152976ef571up+replayingreplaying, {"bytes_per_second":3187302.4,"bytes_per_snapshot":63746048.0,"last_snapshot_bytes":63746048,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:28:50.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:50.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:28:50.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:50.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:50.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:50.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:28:50.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:28:50.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:50.691+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588dcd6c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:50.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:50.691+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/ac9631b8-402a-4ace-b85a-b152976ef571] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:52.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:52.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:52.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:28:52.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:52.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:52.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:52.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:53.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:53.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a0ad399a-ef42-4c2d-9858-d84faab53fa7 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"} 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:53.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:53.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:53.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:53.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:53.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"} 2024-09-14T22:28:53.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:53.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:53.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:53.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:53.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:53.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:53.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:53.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:53.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:53.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:53.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:53.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:53.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:53.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:53.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:53.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:53.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:53.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary7a0ad399a-ef42-4c2d-9858-d84faab53fa7up+replayingreplaying, {"bytes_per_second":3205734.4,"bytes_per_snapshot":64114688.0,"last_snapshot_bytes":64114688,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352856,"remote_snapshot_timestamp":1726352856,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:53.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:53.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:28:53.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:53.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:28:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:53.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:53.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:53.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:53.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:28:53.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:28:53.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:53.706+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a87a820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:53.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:53.706+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/a0ad399a-ef42-4c2d-9858-d84faab53fa7] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:55.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:55.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:28:55.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:55.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:55.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:28:55.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:55.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:55.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:28:55.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:55.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:28:55.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:55.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:28:55.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:55.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:56.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:56.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:28:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:28:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4e6b7719-81e1-491e-b6b0-e9feb6e86cae 2024-09-14T22:28:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"} 2024-09-14T22:28:56.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:56.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:56.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:56.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:56.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:56.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"} 2024-09-14T22:28:56.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:56.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:56.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:56.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:56.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:56.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:56.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:56.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:56.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:56.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:56.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:56.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:56.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:56.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:56.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:56.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:56.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:56.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:56.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary84e6b7719-81e1-491e-b6b0-e9feb6e86caeup+replayingreplaying, {"bytes_per_second":3568640.0,"bytes_per_snapshot":71372800.0,"last_snapshot_bytes":71372800,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352857,"remote_snapshot_timestamp":1726352857,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:56.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:56.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:28:56.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:56.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:28:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:56.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:56.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:56.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:28:56.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:28:56.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:56.713+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a87b1e0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:56.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:56.714+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/4e6b7719-81e1-491e-b6b0-e9feb6e86cae] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:28:58.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:58.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:28:58.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:28:58.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:58.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:28:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:28:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:59.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:28:59.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:28:59.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:59.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:59.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"} 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:28:31' 2024-09-14T22:28:59.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:28:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:28:59.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:28:59.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"} 2024-09-14T22:28:59.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:28:59.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:59.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:28:59.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:59.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:28:59.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:28:59.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:28:59.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:28:31' 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:28:31' 2024-09-14T22:28:59.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:28:59.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:28:59.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:28:59.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":3256320.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31image-primary9b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3up+replayingreplaying, {"bytes_per_second":3137536.0,"bytes_per_snapshot":62750720.0,"last_snapshot_bytes":62750720,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352855,"remote_snapshot_timestamp":1726352855,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:28:31' 2024-09-14T22:28:59.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:28:59.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:28:59.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:28:31' 2024-09-14T22:28:59.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:28:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:28:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:28:59.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:28:59.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:28:59.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:28:59.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:28:59.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:59.676+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58b79f380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:28:59.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:28:59.676+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/b0836bc5-f67a-4f1f-88f7-56e1c47ba4f3] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:29:01.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:29:01.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:29:01.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:01.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:01.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:01.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:29:01.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:29:01.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:29:01.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:01.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:29:01.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:01.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:29:01.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:29:01.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:29:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:29:02.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:29:02.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:29:02.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d1a0113c-484f-4294-b2ac-560dd4a6dde7 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"} 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:29:01' 2024-09-14T22:29:02.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:29:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:29:02.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:29:02.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"} 2024-09-14T22:29:02.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:29:02.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:29:02.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:29:02.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:29:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:29:02.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:29:02.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:29:02.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:29:01' 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:29:01' 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:29:01' 2024-09-14T22:29:02.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:29:02.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:29:02.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:29:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10d1a0113c-484f-4294-b2ac-560dd4a6dde7up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":65126400.0,"last_snapshot_bytes":65126400,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726352853,"remote_snapshot_timestamp":1726352853,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:29:01' 2024-09-14T22:29:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:29:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:29:02.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:29:01' 2024-09-14T22:29:02.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:29:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:29:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:29:02.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:29:02.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:29:02.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:02.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:02.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:29:02.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:29:02.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:02.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:02.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:29:02.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:29:02.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:29:02.724+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a691040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:29:02.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:29:02.724+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/d1a0113c-484f-4294-b2ac-560dd4a6dde7] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:29:04.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:29:04.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:29:04.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:04.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:04.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:04.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:29:04.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:29:04.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:29:04.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:04.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:29:04.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T22:29:04.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T22:29:04.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:04.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:04.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:04.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:04.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:04.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T22:29:04.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:04.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:04.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:04.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:04.395 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T22:29:04.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:04.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T22:29:05.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T22:29:05.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:05.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 379a326bb18a 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.379a326bb18a 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:04 2024 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:04 2024 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:04 2024 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:29:05.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:05.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:05.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:05.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T22:29:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T22:29:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:05.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T22:29:05.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:05.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:05.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:05.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 826125cd-e835-4700-9907-cd329e8d3c17 2024-09-14T22:29:05.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:05.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:05.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:05.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:05.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:05.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:05.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:05.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:05.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T22:29:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T22:29:05.424 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:05.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T22:29:05.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T22:29:05.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:05.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T22:29:05.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:05.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T22:29:06.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2644 2024-09-14T22:29:06.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:06.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:06.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37aae8291ff3 2024-09-14T22:29:06.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37aae8291ff3 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:05 2024 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:05 2024 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:05 2024 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:29:06.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:06.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:06.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:06.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T22:29:06.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T22:29:06.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:06.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T22:29:06.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 50a5a79e-2673-48f6-b74e-8f6002e3e5de 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:06.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:06.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:06.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:06.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:06.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T22:29:06.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T22:29:06.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:06.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T22:29:06.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:06.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T22:29:06.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:06.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:06.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T22:29:06.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T22:29:06.417 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:06.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T22:29:06.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:06.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T22:29:06.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:06.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T22:29:07.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:07.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2646 2024-09-14T22:29:07.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:07.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T22:29:07.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T22:29:07.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:07.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37b946cb5add 2024-09-14T22:29:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37b946cb5add 2024-09-14T22:29:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:06 2024 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:06 2024 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:06 2024 2024-09-14T22:29:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:07.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:07.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:29:07.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:07.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:07.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:07.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T22:29:07.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T22:29:07.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:07.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T22:29:07.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:07.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:07.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 5f48dee3-f1d8-47d9-a39b-9f6801cfee2f 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:07.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:07.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:07.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T22:29:07.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T22:29:07.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:07.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:07.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:07.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T22:29:07.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T22:29:07.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:07.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T22:29:07.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:07.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2648 2024-09-14T22:29:08.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T22:29:08.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37c82b71ceb0 2024-09-14T22:29:08.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37c82b71ceb0 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:07 2024 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:07 2024 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:07 2024 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:29:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:08.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T22:29:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T22:29:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:08.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T22:29:08.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 78d06c0c-5e84-4ce8-993d-b59ce537123d 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:08.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:08.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:08.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:08.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T22:29:08.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T22:29:08.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:08.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:08.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:08.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:08.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:08.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:08.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:08.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T22:29:08.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:08.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T22:29:09.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:09.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:09.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:09.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:09.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2650 2024-09-14T22:29:09.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:09.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:09.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T22:29:09.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T22:29:09.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37d7e840b052 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37d7e840b052 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:08 2024 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:08 2024 2024-09-14T22:29:09.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:08 2024 2024-09-14T22:29:09.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:09.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:09.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:29:09.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:09.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:09.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:09.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T22:29:09.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T22:29:09.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:09.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T22:29:09.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 28bad4b3-3c08-400a-911e-264e3ce0a7af 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:09.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:09.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:09.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:09.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:09.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T22:29:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T22:29:09.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:09.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:09.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:09.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:09.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:09.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:09.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:09.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T22:29:09.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:09.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T22:29:09.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:09.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:10.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:10.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2653 2024-09-14T22:29:10.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:10.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:10.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2652 2024-09-14T22:29:10.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T22:29:10.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:10.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37e952986c46 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37e952986c46 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:09 2024 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:09 2024 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:09 2024 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:10.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:10.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:29:10.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:10.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:10.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:10.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T22:29:10.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T22:29:10.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:10.652 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T22:29:10.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:10.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 805d75f8-1bbc-4001-a8cb-a1ca486ab068 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:10.688 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:10.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:10.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:10.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:10.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T22:29:10.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T22:29:10.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:10.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T22:29:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:10.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T22:29:10.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T22:29:10.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:10.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T22:29:10.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T22:29:11.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:11.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:11.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:11.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:11.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:11.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:11.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:11.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:11.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T22:29:11.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2655 2024-09-14T22:29:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:11.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:11.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T22:29:12.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:12.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2658 2024-09-14T22:29:12.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2656 2024-09-14T22:29:12.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:12.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:12.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:12.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:12.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T22:29:12.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:12.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 37f95ef476c4 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.37f95ef476c4 2024-09-14T22:29:12.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:11 2024 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:11 2024 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:11 2024 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:29:12.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:12.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:12.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:12.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T22:29:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T22:29:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T22:29:12.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 03dc560d-cd8c-4e51-bb14-bcf1b579ca77 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:12.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:12.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:12.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:12.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:12.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T22:29:12.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T22:29:12.671 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:12.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T22:29:12.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:12.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T22:29:12.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:12.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:12.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:12.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:12.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:12.701 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T22:29:12.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:12.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T22:29:12.971 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:12.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2660 2024-09-14T22:29:12.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2659 2024-09-14T22:29:12.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T22:29:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:12.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:13.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:13.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T22:29:13.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 380df493c8bf 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.380df493c8bf 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:12 2024 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:12 2024 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:12 2024 2024-09-14T22:29:13.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:13.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:13.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:29:13.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:13.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:13.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:13.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:13.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T22:29:13.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:13.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:13.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:13.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:13.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T22:29:13.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:13.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T22:29:13.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b53fc794-bda4-4a54-9d43-dc709e2b0e7f 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:13.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:13.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:13.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:13.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:13.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:13.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T22:29:13.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T22:29:13.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:13.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T22:29:13.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:13.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T22:29:13.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:13.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:13.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T22:29:13.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T22:29:13.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:13.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T22:29:13.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:13.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:13.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T22:29:13.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:13.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T22:29:13.967 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2664 2024-09-14T22:29:13.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2662 2024-09-14T22:29:13.976 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2663 2024-09-14T22:29:13.980 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:13.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:13.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:13.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T22:29:14.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:14.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T22:29:14.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:14.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:14.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:14.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3820d59e34fc 2024-09-14T22:29:14.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3820d59e34fc 2024-09-14T22:29:14.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:13 2024 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:13 2024 2024-09-14T22:29:14.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:13 2024 2024-09-14T22:29:14.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:14.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:14.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:29:14.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:14.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:14.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:14.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T22:29:14.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:14.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:14.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:14.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:14.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T22:29:14.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:14.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T22:29:14.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:14.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 60506107-8482-4cbb-907c-0c7c9c16c089 2024-09-14T22:29:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:14.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:14.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:14.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:14.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:14.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:14.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:14.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T22:29:14.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T22:29:14.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:14.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:14.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:14.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:29:14.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T22:29:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:29:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:29:14.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:29:14.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T22:29:15.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:15.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T22:29:15.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:29:15.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2666 2024-09-14T22:29:15.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2667 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:15.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:15.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T22:29:15.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 383261297313 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.383261297313 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:29:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:29:14 2024 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:29:14 2024 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:29:14 2024 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:29:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:29:15.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:29:15.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:29:15.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T22:29:15.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T22:29:15.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:29:15.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T22:29:15.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b9e28bc0-b71d-47ac-b474-8727f1b2c062 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:29:15.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:29:15.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:29:15.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:29:15.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:29:15.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T22:29:15.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T22:29:15.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:29:15.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:15.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 130780 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T22:29:15.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T22:29:15.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:29:15.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T22:29:15.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2671 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:15.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:16.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2670 2024-09-14T22:29:16.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2669 2024-09-14T22:29:16.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:16.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:16.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:16.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:16.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:16.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:16.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:17.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:17.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2672 2024-09-14T22:29:17.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2673 2024-09-14T22:29:17.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:17.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:18.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:18.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:18.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:18.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:18.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:18.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:18.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:18.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:18.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:18.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2675 2024-09-14T22:29:18.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2676 2024-09-14T22:29:18.338 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:18.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2674 2024-09-14T22:29:18.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:18.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:19.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:19.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:19.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:19.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:19.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:19.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:19.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:19.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:19.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:19.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:19.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:19.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:19.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2678 2024-09-14T22:29:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2677 2024-09-14T22:29:19.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:19.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:20.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:20.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:20.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:20.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:20.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:20.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:20.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2681 2024-09-14T22:29:20.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2680 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:20.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:20.241 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2679 2024-09-14T22:29:20.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:20.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:20.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:21.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2683 2024-09-14T22:29:21.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2682 2024-09-14T22:29:21.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:21.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:21.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:21.345 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:21.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:21.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:21.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:21.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:21.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:21.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:21.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:21.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:21.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:21.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:21.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:21.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:21.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:21.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:21.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:21.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:22.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2685 2024-09-14T22:29:22.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2684 2024-09-14T22:29:22.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:22.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2686 2024-09-14T22:29:22.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:22.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:22.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:22.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:22.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:22.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:22.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:22.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:22.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:22.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:22.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:22.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:22.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:22.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:22.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2688 2024-09-14T22:29:22.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2687 2024-09-14T22:29:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:22.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:23.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:23.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:23.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:23.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:23.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:23.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:23.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:23.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:23.970 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2689 2024-09-14T22:29:23.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:23.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2690 2024-09-14T22:29:23.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2691 2024-09-14T22:29:23.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:24.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:24.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:24.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:24.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:24.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:24.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:24.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:24.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2692 2024-09-14T22:29:24.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2693 2024-09-14T22:29:24.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:25.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:25.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:25.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:25.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:25.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:25.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:25.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:25.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:25.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:25.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:25.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:25.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:25.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2695 2024-09-14T22:29:25.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2694 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:26.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:26.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:26.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:26.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:26.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:26.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:26.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:26.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:26.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:26.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:27.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:27.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2698 2024-09-14T22:29:27.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:27.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2696 2024-09-14T22:29:27.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:27.998 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:28.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:28.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2699 2024-09-14T22:29:28.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:28.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2700 2024-09-14T22:29:28.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:28.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2697 2024-09-14T22:29:29.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:29.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:29.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:29.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:29.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:29.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:29.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2701 2024-09-14T22:29:29.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:29.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:29.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2703 2024-09-14T22:29:29.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:30.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2702 2024-09-14T22:29:30.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:30.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:30.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:30.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:30.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:30.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:30.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:30.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2705 2024-09-14T22:29:30.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:30.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:31.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2704 2024-09-14T22:29:31.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:31.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2706 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:31.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:31.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:31.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:31.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:31.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:31.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:31.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:31.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:32.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2707 2024-09-14T22:29:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:32.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:32.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2708 2024-09-14T22:29:32.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:32.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:32.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:32.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:32.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:32.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:32.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:32.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:32.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:33.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2710 2024-09-14T22:29:33.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:33.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:34.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2709 2024-09-14T22:29:34.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:34.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:34.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:34.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:34.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:34.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:34.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:34.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:34.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2712 2024-09-14T22:29:35.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2711 2024-09-14T22:29:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:35.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:35.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:35.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2714 2024-09-14T22:29:35.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2713 2024-09-14T22:29:35.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:35.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:35.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:35.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:35.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:35.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:35.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:35.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:36.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2715 2024-09-14T22:29:36.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2716 2024-09-14T22:29:36.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:36.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:37.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:37.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2717 2024-09-14T22:29:37.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2718 2024-09-14T22:29:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:37.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2719 2024-09-14T22:29:38.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:38.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:38.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:38.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:38.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2720 2024-09-14T22:29:38.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:38.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:38.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:38.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:38.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:38.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:38.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:39.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:39.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:39.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2723 2024-09-14T22:29:39.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:39.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2721 2024-09-14T22:29:39.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:40.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2724 2024-09-14T22:29:40.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:40.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2722 2024-09-14T22:29:40.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:40.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:40.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:40.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:40.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:40.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:40.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:40.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:40.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:40.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:40.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:40.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:40.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:41.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:41.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2726 2024-09-14T22:29:41.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2725 2024-09-14T22:29:41.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:41.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:41.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:41.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:41.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:41.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:41.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:41.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:42.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2727 2024-09-14T22:29:42.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2728 2024-09-14T22:29:42.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:42.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:42.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:42.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:42.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:42.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:42.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:42.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:42.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:42.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2729 2024-09-14T22:29:43.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:43.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2730 2024-09-14T22:29:43.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:43.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:43.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:43.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:43.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:43.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:43.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:43.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:44.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2732 2024-09-14T22:29:44.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:44.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:44.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:44.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:44.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:44.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:44.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:44.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:44.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2731 2024-09-14T22:29:45.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:45.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2734 2024-09-14T22:29:45.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:45.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:45.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:45.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:45.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:45.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:45.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:45.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:45.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2733 2024-09-14T22:29:46.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2735 2024-09-14T22:29:46.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:46.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:46.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:46.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:46.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:46.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:46.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:46.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:46.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2736 2024-09-14T22:29:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:46.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:47.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2738 2024-09-14T22:29:47.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:47.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:47.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:47.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:47.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:47.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:47.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:47.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2737 2024-09-14T22:29:47.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:48.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:48.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2739 2024-09-14T22:29:48.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:48.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2740 2024-09-14T22:29:48.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:48.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2741 2024-09-14T22:29:49.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:49.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:49.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2742 2024-09-14T22:29:49.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:49.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:49.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:49.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:49.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:49.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:49.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:49.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2744 2024-09-14T22:29:50.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:50.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:50.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:50.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:50.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:50.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:50.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:50.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2743 2024-09-14T22:29:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:51.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:51.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:51.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:51.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:51.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:51.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:51.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:51.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:51.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:51.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:51.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:51.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:51.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2745 2024-09-14T22:29:52.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2746 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:52.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2747 2024-09-14T22:29:52.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:52.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:52.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:52.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:52.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:52.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:52.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:52.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:52.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:52.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2748 2024-09-14T22:29:53.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:53.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2749 2024-09-14T22:29:53.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2750 2024-09-14T22:29:53.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:53.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:54.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:54.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2752 2024-09-14T22:29:54.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2751 2024-09-14T22:29:54.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:54.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:55.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:55.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:55.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:55.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:55.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:55.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2753 2024-09-14T22:29:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:55.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:29:55.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:29:55.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:29:55.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2754 2024-09-14T22:29:55.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:29:56.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:29:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:29:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:29:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:29:56.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:56.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:29:56.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:56.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:56.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:29:56.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:29:56.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2755 2024-09-14T22:29:56.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:56.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2756 2024-09-14T22:29:56.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:57.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2757 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:29:57.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:29:57.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:57.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:29:57.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:57.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:57.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:29:57.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:29:57.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:57.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2758 2024-09-14T22:29:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:58.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2759 2024-09-14T22:29:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2760 2024-09-14T22:29:58.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:58.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:58.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:58.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:29:58.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:58.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:58.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:29:58.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:29:58.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:29:59.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2762 2024-09-14T22:29:59.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2761 2024-09-14T22:29:59.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:59.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:29:59.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:29:59.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:29:59.335 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:29:59.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:29:59.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:29:59.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:29:59.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:00.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2763 2024-09-14T22:30:00.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2764 2024-09-14T22:30:00.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:00.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:00.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:00.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:00.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:00.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:00.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:00.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:00.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:01.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:01.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:01.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:01.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:01.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:01.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:01.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:01.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2766 2024-09-14T22:30:01.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2765 2024-09-14T22:30:01.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:01.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:02.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:02.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:02.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:30:02.342+0000 7f81acc00640 -1 rbd::mirror::image_replayer::snapshot::Replayer: 0x55b589bf6c00 handle_unlink_peer: failed to unlink local peer from remote image: (22) Invalid argument 2024-09-14T22:30:02.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2768 2024-09-14T22:30:02.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2767 2024-09-14T22:30:03.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2769 2024-09-14T22:30:03.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:03.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2770 2024-09-14T22:30:03.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:03.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:03.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:03.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:03.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:03.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:03.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:03.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:03.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:03.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:04.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2771 2024-09-14T22:30:04.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2772 2024-09-14T22:30:04.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:04.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:04.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:04.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:06.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:06.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:06.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:06.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:06.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:06.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:06.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2774 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:06.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2773 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:06.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:06.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:06.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:06.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:06.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2775 2024-09-14T22:30:06.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:06.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2776 2024-09-14T22:30:06.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:07.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:07.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:07.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:07.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:07.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:07.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:07.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2779 2024-09-14T22:30:07.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2777 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:07.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:07.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:07.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:09.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2778 2024-09-14T22:30:09.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2780 2024-09-14T22:30:09.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:09.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:09.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:09.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:09.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:10.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2781 2024-09-14T22:30:10.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2782 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:10.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:10.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:10.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:10.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2783 2024-09-14T22:30:10.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2784 2024-09-14T22:30:10.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:10.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:11.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2786 2024-09-14T22:30:11.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2785 2024-09-14T22:30:11.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:11.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:11.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2788 2024-09-14T22:30:11.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:12.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:12.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:12.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:12.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:12.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:12.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:12.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2787 2024-09-14T22:30:12.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:13.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2789 2024-09-14T22:30:13.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2790 2024-09-14T22:30:13.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:13.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:13.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:13.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:13.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:13.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:13.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:13.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:13.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:13.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:13.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:13.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:13.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:13.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:13.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:14.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2791 2024-09-14T22:30:14.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2792 2024-09-14T22:30:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:14.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:14.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:14.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:14.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:14.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:14.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:14.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:14.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:15.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2797 2024-09-14T22:30:15.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:15.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:15.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:15.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:15.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:15.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:15.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:16.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:16.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:16.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:16.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:16.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:16.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2794 2024-09-14T22:30:16.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2793 2024-09-14T22:30:16.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:16.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2796 2024-09-14T22:30:16.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:16.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:16.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2795 2024-09-14T22:30:16.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:17.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2798 2024-09-14T22:30:17.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:17.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:17.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:18.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:18.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2799 2024-09-14T22:30:18.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2800 2024-09-14T22:30:18.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:19.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:19.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2802 2024-09-14T22:30:19.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:19.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2803 2024-09-14T22:30:19.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:19.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:19.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:19.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:19.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2801 2024-09-14T22:30:19.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:20.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2805 2024-09-14T22:30:20.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2804 2024-09-14T22:30:20.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:20.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:20.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:21.966 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2807 2024-09-14T22:30:21.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2806 2024-09-14T22:30:22.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:22.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:22.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:22.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:22.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:22.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:22.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:22.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:22.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:22.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:22.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:22.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:22.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:22.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:22.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:22.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:22.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:22.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:22.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:22.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:22.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:22.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2808 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:22.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:23.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:23.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2810 2024-09-14T22:30:23.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2809 2024-09-14T22:30:23.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:23.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:23.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:23.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2812 2024-09-14T22:30:24.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:24.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2813 2024-09-14T22:30:24.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:24.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2811 2024-09-14T22:30:25.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:25.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:25.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:25.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:25.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:25.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:25.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:25.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:25.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:25.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:25.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:25.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:25.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:25.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2815 2024-09-14T22:30:25.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2814 2024-09-14T22:30:26.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:26.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:26.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:26.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:26.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:26.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:26.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:26.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:26.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:26.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:26.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:26.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:26.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:26.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:26.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2817 2024-09-14T22:30:26.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:26.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:26.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:26.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:26.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:26.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:26.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:26.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2816 2024-09-14T22:30:26.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:27.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:27.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2818 2024-09-14T22:30:27.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:27.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:27.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:27.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:27.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:27.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:27.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:28.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:29.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2821 2024-09-14T22:30:29.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2820 2024-09-14T22:30:29.021 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2819 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:29.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:29.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:29.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:29.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:29.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:29.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:29.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:29.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:29.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:29.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:29.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2823 2024-09-14T22:30:29.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:30.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2822 2024-09-14T22:30:30.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:30.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:30.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:30.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:30.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:30.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:30.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:30.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2824 2024-09-14T22:30:30.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2825 2024-09-14T22:30:30.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:30.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:32.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2826 2024-09-14T22:30:32.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2827 2024-09-14T22:30:32.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:32.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:32.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:32.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:32.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:32.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:32.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:32.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:32.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:32.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:32.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:32.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:32.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:32.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:32.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:32.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2828 2024-09-14T22:30:33.009 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:33.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:33.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:33.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2831 2024-09-14T22:30:33.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2829 2024-09-14T22:30:33.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:33.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:33.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:33.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:33.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:34.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2830 2024-09-14T22:30:34.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:34.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2833 2024-09-14T22:30:34.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:35.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2832 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:35.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:35.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:35.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:35.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:35.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2835 2024-09-14T22:30:35.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:36.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:36.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:36.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:36.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:36.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:36.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2834 2024-09-14T22:30:36.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:36.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:36.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:36.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2836 2024-09-14T22:30:36.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2837 2024-09-14T22:30:36.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:36.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:37.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2838 2024-09-14T22:30:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:37.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:37.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:37.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:37.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:37.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:37.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:37.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:37.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:37.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:38.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:38.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:38.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:38.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:38.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:38.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:38.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:38.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:38.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2840 2024-09-14T22:30:39.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2839 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:39.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:39.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:39.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:39.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:39.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:39.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:39.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:39.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:39.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:39.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:39.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2843 2024-09-14T22:30:39.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:40.058 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2842 2024-09-14T22:30:40.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:40.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:40.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:40.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:40.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:40.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:40.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:40.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2844 2024-09-14T22:30:40.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:40.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2845 2024-09-14T22:30:40.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:41.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2846 2024-09-14T22:30:41.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2847 2024-09-14T22:30:41.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:41.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:42.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:42.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:42.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:42.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:42.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:42.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:42.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:42.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:42.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:42.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:42.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:42.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:42.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:42.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:42.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:42.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:42.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:42.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:42.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2841 2024-09-14T22:30:42.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2848 2024-09-14T22:30:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:43.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:43.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2850 2024-09-14T22:30:43.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2849 2024-09-14T22:30:43.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:43.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:43.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:43.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:43.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:43.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:44.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2851 2024-09-14T22:30:44.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:44.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2852 2024-09-14T22:30:44.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:44.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:44.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:44.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:44.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:44.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:44.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:44.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:45.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2853 2024-09-14T22:30:45.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2854 2024-09-14T22:30:45.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:45.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:46.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:46.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:46.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:46.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:46.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:46.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:46.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:46.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:46.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:46.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:46.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:46.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:46.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:46.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:46.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:46.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:46.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2855 2024-09-14T22:30:46.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2856 2024-09-14T22:30:46.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:46.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:47.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2858 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:47.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2857 2024-09-14T22:30:47.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:47.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:47.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:47.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:47.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:47.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:47.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:47.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:48.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2859 2024-09-14T22:30:48.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:48.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2860 2024-09-14T22:30:48.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:48.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:48.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:48.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:49.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:49.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:49.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:49.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:49.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2862 2024-09-14T22:30:49.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2861 2024-09-14T22:30:50.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:50.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:50.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:50.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2864 2024-09-14T22:30:50.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2863 2024-09-14T22:30:51.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:51.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:51.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:51.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:51.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:51.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2866 2024-09-14T22:30:51.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2865 2024-09-14T22:30:52.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:52.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2868 2024-09-14T22:30:52.972 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2867 2024-09-14T22:30:53.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:53.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:53.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:53.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:53.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:53.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:53.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:53.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:53.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:53.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:53.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:53.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:53.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:53.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2870 2024-09-14T22:30:53.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2869 2024-09-14T22:30:54.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:54.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:54.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:54.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:54.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:54.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2872 2024-09-14T22:30:54.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2871 2024-09-14T22:30:54.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:54.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:55.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2874 2024-09-14T22:30:55.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2873 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:55.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:55.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:55.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:55.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:55.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:55.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:55.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:30:55.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:56.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2875 2024-09-14T22:30:56.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2876 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:30:56.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:30:56.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:30:56.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:30:56.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:57.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2878 2024-09-14T22:30:57.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2877 2024-09-14T22:30:57.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:57.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:30:57.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:30:57.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:30:57.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:30:58.012 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2879 2024-09-14T22:30:58.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2880 2024-09-14T22:30:58.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:58.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:30:58.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:30:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:30:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:58.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:30:58.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:30:59.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:30:59.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:30:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:30:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:30:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:30:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:30:59.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:00.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2882 2024-09-14T22:31:00.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2881 2024-09-14T22:31:00.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:00.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:00.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:00.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:00.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:00.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:00.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:00.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:01.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2884 2024-09-14T22:31:01.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:01.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:01.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:01.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2883 2024-09-14T22:31:01.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:01.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:02.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2886 2024-09-14T22:31:02.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2885 2024-09-14T22:31:02.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:02.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:02.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2887 2024-09-14T22:31:02.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2888 2024-09-14T22:31:03.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:03.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:03.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2890 2024-09-14T22:31:03.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2889 2024-09-14T22:31:03.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:03.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:03.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:03.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:04.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2891 2024-09-14T22:31:04.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2892 2024-09-14T22:31:04.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:04.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:04.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:04.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:04.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:04.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:04.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:04.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:04.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:04.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:04.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:04.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:04.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:04.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:05.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2893 2024-09-14T22:31:05.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2894 2024-09-14T22:31:05.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:05.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:05.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:05.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:06.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:06.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:06.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:06.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:06.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:06.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:06.031 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:06.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2896 2024-09-14T22:31:06.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2895 2024-09-14T22:31:06.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:06.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:06.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:06.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:06.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:06.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:06.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:07.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:07.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:07.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2898 2024-09-14T22:31:07.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2897 2024-09-14T22:31:07.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:07.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:08.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:08.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:08.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:08.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:09.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2900 2024-09-14T22:31:09.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2899 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:09.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:09.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:09.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:09.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:10.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2901 2024-09-14T22:31:10.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:10.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:10.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:10.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:10.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:10.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:10.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2902 2024-09-14T22:31:10.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:10.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:11.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2903 2024-09-14T22:31:11.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2904 2024-09-14T22:31:11.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:11.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:12.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2906 2024-09-14T22:31:12.080 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2905 2024-09-14T22:31:12.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:12.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:12.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:12.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:12.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:12.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:12.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:12.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:12.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2908 2024-09-14T22:31:12.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2907 2024-09-14T22:31:13.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:13.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:13.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2910 2024-09-14T22:31:13.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2909 2024-09-14T22:31:13.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:13.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:13.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:13.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:13.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2912 2024-09-14T22:31:14.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2911 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:14.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:14.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:15.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2913 2024-09-14T22:31:15.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2914 2024-09-14T22:31:15.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:15.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:15.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:15.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:15.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:16.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:16.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:16.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:16.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:16.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:16.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:16.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:16.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:16.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:16.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:16.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2916 2024-09-14T22:31:16.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2915 2024-09-14T22:31:16.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:16.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:17.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2917 2024-09-14T22:31:17.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:17.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:17.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2918 2024-09-14T22:31:17.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:17.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:18.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2919 2024-09-14T22:31:18.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2920 2024-09-14T22:31:18.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:18.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:18.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:18.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:19.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:19.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:20.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2922 2024-09-14T22:31:20.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2921 2024-09-14T22:31:20.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:20.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:20.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:20.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:20.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:20.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:20.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:20.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:20.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:20.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:31:20.200+0000 7f81ad600640 -1 rbd::mirror::image_replayer::snapshot::Replayer: 0x55b589ad8c00 handle_unlink_peer: failed to unlink local peer from remote image: (22) Invalid argument 2024-09-14T22:31:21.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:21.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:21.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:21.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:21.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:21.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:21.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:21.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2924 2024-09-14T22:31:21.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2923 2024-09-14T22:31:21.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2925 2024-09-14T22:31:21.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:21.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2926 2024-09-14T22:31:21.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:21.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:21.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:22.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2927 2024-09-14T22:31:22.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2928 2024-09-14T22:31:22.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:22.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:23.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2930 2024-09-14T22:31:23.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2929 2024-09-14T22:31:23.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:23.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:23.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:23.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:23.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:23.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:23.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:23.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:23.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:24.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2932 2024-09-14T22:31:24.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2931 2024-09-14T22:31:24.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:24.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:24.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:24.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:24.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:24.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:24.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:24.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:24.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:24.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:24.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:24.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:24.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:24.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:24.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:24.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:24.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:24.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:25.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2933 2024-09-14T22:31:25.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2935 2024-09-14T22:31:25.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:25.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:25.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:25.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:31:25.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:25.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:25.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:31:25.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:25.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:26.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:26.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:26.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:26.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:26.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:26.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:31:26.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:31:26.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2936 2024-09-14T22:31:26.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2934 2024-09-14T22:31:26.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:26.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:27.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:27.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:31:27.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:27.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:27.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:31:27.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:27.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2938 2024-09-14T22:31:27.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2937 2024-09-14T22:31:27.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:27.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:28.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2940 2024-09-14T22:31:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2939 2024-09-14T22:31:28.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:31:28.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:31:28.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:28.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:28.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:28.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:28.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:28.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:29.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2943 2024-09-14T22:31:29.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:31:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:29.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2942 2024-09-14T22:31:29.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2941 2024-09-14T22:31:30.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:30.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:30.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:30.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:30.208 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:30.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:30.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 130912 2024-09-14T22:31:30.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2944 2024-09-14T22:31:31.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131044 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:31:31.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:31:31.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2945 2024-09-14T22:31:31.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2946 2024-09-14T22:31:32.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:32.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2947 2024-09-14T22:31:33.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:31:33.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:31:33.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:31:33.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:33.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131176 2024-09-14T22:31:33.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:33.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131328 2024-09-14T22:31:33.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2948 2024-09-14T22:31:34.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:31:34.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:31:34.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2949 2024-09-14T22:31:34.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:35.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2950 2024-09-14T22:31:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:35.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131481 2024-09-14T22:31:35.034 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:35.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:31:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:31:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:31:36.017 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:31:36.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:31:36.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:31:36.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:31:36.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:31:36.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:31:36.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2951 2024-09-14T22:31:36.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:37.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:37.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131655 2024-09-14T22:31:37.038 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2952 2024-09-14T22:31:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:31:37.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:37.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131828 2024-09-14T22:31:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131982 2024-09-14T22:31:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:31:39.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 132155 2024-09-14T22:31:40.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:31:40.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:31:40.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 130781 2024-09-14T22:34:05.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:05.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:05.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:05.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 130913 2024-09-14T22:34:06.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:06.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:06.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:06.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131045 2024-09-14T22:34:07.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:07.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:07.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:07.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131177 2024-09-14T22:34:08.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:08.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:08.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:08.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131329 2024-09-14T22:34:09.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:09.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:09.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:09.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131482 2024-09-14T22:34:11.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:11.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:11.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:11.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131656 2024-09-14T22:34:13.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:13.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:13.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:13.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131829 2024-09-14T22:34:13.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:13.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:13.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 131983 2024-09-14T22:34:15.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:15.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:15.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:34:15.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 132156 2024-09-14T22:34:15.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:34:15.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:34:15.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:34:15.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:34:15.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:34:15.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:34:15.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.988 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.989 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:34:15.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:34:15.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138098 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:34:15.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:34:16.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:34:16.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:34:16.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:34:16.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.746 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:34:16.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:34:16.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:34:16.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:34:16.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:34:16.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:34:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:34:16.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:34:16.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:10.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=8ebf76bf03c09e7b141d0aba75227b46 2024-09-14T22:35:10.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:35:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:35:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:10.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:10.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:35:11.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=55db0e00da5384f8b06b5a55757267a7 2024-09-14T22:35:11.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:35:11.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4bc8293b862c8ed546b4aacd19528b58 2024-09-14T22:35:11.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:35:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:35:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:11.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:35:11.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4283bbcc0937443acada509891038c4d 2024-09-14T22:35:11.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:35:11.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:35:11.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:11.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:11.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:11.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:35:11.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:35:11.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:11.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:11.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:11.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:35:11.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0899c61dc7c2df13b32ff8aab26fe2a1 2024-09-14T22:35:11.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:35:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:35:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:35:12.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:12.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:35:12.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:12.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:12.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:12.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:12.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:12.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:12.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:12.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:12.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a48ccf1615cbe5bc372a0b530d080df6 2024-09-14T22:35:12.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:35:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=89030f3446d4fd4a2b1ffe14b3e32832 2024-09-14T22:35:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:35:12.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:35:12.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:12.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:12.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:12.518 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:35:12.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:35:12.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:12.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:12.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:12.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:35:13.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:13.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:13.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:13.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:13.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:13.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:35:13.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:35:13.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:13.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:13.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:35:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:35:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:13.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:13.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:13.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:13.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:35:13.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:13.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:13.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=48d76cf8101b0162f9eb30f5f38b4173 2024-09-14T22:35:13.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:35:13.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:13.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:13.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:13.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:13.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:13.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:13.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:13.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:13.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:13.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:13.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:35:13.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:13.341 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:35:13.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=14c82a250d2e74831e9b1e25771376ec 2024-09-14T22:35:13.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:35:13.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:35:13.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:13.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:13.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:13.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:35:14.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:14.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:35:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:14.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:14.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:14.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:14.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:14.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:35:14.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:14.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:14.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:14.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:35:14.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:14.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:14.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:14.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:14.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:14.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:14.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:14.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:14.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:14.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:14.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:14.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:14.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:14.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:14.512 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:14.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:14.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:14.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:15.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:15.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:15.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:15.093 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:15.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:15.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:15.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:15.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:15.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:15.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:15.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:15.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:15.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:15.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:15.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:15.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:15.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:15.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:15.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:15.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:15.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:15.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:15.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:15.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:15.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:15.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:15.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:15.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:15.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:35:15.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:15.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:15.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:15.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:15.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:15.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:15.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:15.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:15.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:15.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=5cbce8017878139a20971291542c6223 2024-09-14T22:35:15.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:35:15.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:35:15.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:15.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:15.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:15.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:35:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:16.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:35:16.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:16.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:16.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:16.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:16.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:16.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:35:16.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:16.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:16.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:16.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:16.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:16.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:16.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:16.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:16.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:16.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:16.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:35:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:16.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:35:16.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:16.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:16.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:16.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:35:16.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:16.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:16.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:16.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:16.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:16.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:16.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:16.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:16.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:16.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:16.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:16.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:16.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:16.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:16.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:16.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:16.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:16.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:16.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:16.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:16.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:17.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:17.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:17.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:17.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:17.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:17.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:17.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:17.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:17.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:17.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:17.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:35:17.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:17.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:17.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:17.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:17.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:35:17.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:17.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:17.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:17.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:17.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:17.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:17.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:17.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:17.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:17.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:17.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:17.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:17.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:17.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:18.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:18.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:18.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:18.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:18.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:18.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:18.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:18.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:18.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:18.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:18.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:18.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:18.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:18.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:19.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:19.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:19.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:35:19.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:35:19.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:35:19.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:19.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:19.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:19.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:19.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:19.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:19.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:19.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:19.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:19.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:19.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:19.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:19.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:19.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:19.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:20.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:20.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:20.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:20.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:20.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:20.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:20.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:20.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:20.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:20.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:20.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:20.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:20.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:20.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:20.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:20.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:20.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:20.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:20.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:20.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:20.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:20.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:20.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:20.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:20.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:20.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:20.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:20.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:21.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:35:21.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:21.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:21.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:21.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:21.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:35:21.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:21.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:21.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:21.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:35:21.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:21.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:21.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:35:21.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:21.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:21.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:21.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:21.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:21.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:21.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:21.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:21.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:22.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:22.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:22.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:35:22.444 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:22.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:22.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:22.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:22.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:23.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:35:23.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:23.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:23.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:23.384 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:25.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:25.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:25.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:25.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:27.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:27.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:27.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:35:27.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:27.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:27.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:28.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:28.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:28.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:28.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:28.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:28.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:28.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:35:28.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:28.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:28.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:28.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:28.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:28.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:28.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:28.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:28.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:28.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:28.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:35:28.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:28.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:28.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:28.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:28.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:28.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:28.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:28.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:28.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:28.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:28.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:28.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:28.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:28.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:28.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:29.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:29.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:29.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:29.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:35:29.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:29.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:29.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:29.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:29.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:29.548 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:29.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:29.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:29.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:29.551 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:30.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:30.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:30.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:30.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:30.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:30.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:30.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:30.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:30.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:30.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:35:30.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:01' 2024-09-14T22:35:30.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:30.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:35:30.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:30.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:35:31.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:35:31.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:31.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:35:31.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:35:31.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:35:31.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:31.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:31.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:31.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:31.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:31.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:31.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:31.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:31.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:31.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:31.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:31.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:35:31.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:31.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:35:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:31.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:31.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:31.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:31.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:31.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:32.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:32.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:35:32.744 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:32.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:32.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:32.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:32.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:32.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:32.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:32.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:32.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:32.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:32.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:32.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:32.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:32.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:32.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:32.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:32.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:35:32.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:32.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:35:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:32.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:35:32.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:35:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:32.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:35:33.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:33.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:33.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:33.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:35:33.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:33.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:35:33.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:35:33.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:35:33.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:33.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:33.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:33.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:33.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:33.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:33.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:33.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:33.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:33.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:33.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:33.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:33.400 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:33.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:33.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:33.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:33.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:35:33.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:33.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:35:33.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:33.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:33.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:33.537 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:33.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:34.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:35:34.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:34.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:34.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:34.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:35:34.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:34.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:34.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:34.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:34.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:34.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:34.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:34.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:34.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:34.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:34.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:34.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:34.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:34.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:34.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:34.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:34.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:34.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:34.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:34.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:34.747 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:34.748 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:35:34.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:34.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:35:34.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:34.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:34.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:34.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:35:34.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:34.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:35:35.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:35.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:35.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:35:35.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:35:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:35:35.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:35.529 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:35.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:35.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:35.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:35.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:35:35.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:35.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:35.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:35.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:35.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:35.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:35.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:35.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:35.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:35.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:35.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:35.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:35.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:35.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:35.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:35.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:35.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:35.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:35.752 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:35:35.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:35.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:35:35.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:35.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:35.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:35.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:35.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:36.683 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.684 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:36.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:35:36.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:35:36.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:36.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:36.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:36.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:36.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:36.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:36.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:36.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:36.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:36.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:36.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:36.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:36.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:36.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:36.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:36.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:35:36.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:36.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:36.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:36.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:36.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:36.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:36.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:36.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:36.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:36.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:36.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:36.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:36.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:36.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:36.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:36.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:36.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:36.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:36.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:36.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:36.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:36.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:36.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:36.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:36.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:36.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:36.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:36.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:36.902 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:36.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:36.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:36.907 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:36.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:36.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:36.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:36.910 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:36.912 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:36.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:36.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:36.914 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:36.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:36.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:36.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:36.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:36.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:36.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:36.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:36.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:36.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:36.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:37.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.018 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.019 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:35:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:35:37.026 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:35:37.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:35:37.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.050 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:35:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:37.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.059 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:35:37.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:35:37.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:35:37.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:35:37.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:37.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:35:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:35:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:35:37.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:37.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:37.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:37.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:37.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:37.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:35:37.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:37.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:37.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:37.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:37.631 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:37.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.632 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:37.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:37.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:37.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:37.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:37.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:37.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:37.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:37.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:37.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:37.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:37.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:37.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:37.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:37.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:37.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:37.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:37.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:37.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:37.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:35:37.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:35:37.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:37.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:35:37.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:37.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:35:37.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:37.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:37.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:37.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:37.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:37.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:35:37.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:37.812 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:37.813 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.057 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.060 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.061 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:35:38.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:35:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:35:38.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:35:38.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:35:38.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:38.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:38.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:38.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:35:38.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:35:38.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:35:38.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.336 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.418 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:38.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:38.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:35:38.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:35:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:38.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:38.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:35:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:38.447 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:38.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:35:38.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:35:38.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:38.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:38.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:35:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:35:38.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:38.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:35:38.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:38.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:38.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.544 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:38.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:35:38.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:38.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:38.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:35:38.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:35:38.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:38.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:38.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:35:38.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:35:38.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:38.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:38.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:35:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:38.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:35:38.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.667 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:35:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:38.675 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:38.680 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.681 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:35:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:35:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:38.682 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:35:38.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:35:38.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:38.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:38.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:35:38.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:35:38.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:38.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:38.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:38.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:35:38.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.938 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.939 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.943 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.944 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:35:38.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:35:38.948 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:38.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:38.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:38.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:38.949 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:38.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.951 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.952 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:38.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:38.953 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.956 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:38.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:38.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:38.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:38.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:38.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:38.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:38.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:38.985 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:38.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:38.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:39.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:39.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:39.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:35:39.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:39.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:35:39.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:39.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:39.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:39.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:39.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:39.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:39.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:35:39.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:39.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:39.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:35:39.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:39.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:39.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:35:39.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:39.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:39.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:39.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:39.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:39.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:39.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:39.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:35:39.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:39.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:39.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:35:39.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:39.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:39.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:35:39.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:39.340 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:39.344 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:35:39.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:39.351 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:39.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:35:39.559 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:35:39.562 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:35:39.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:39.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:35:39.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:39.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:35:39.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:35:39.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:35:39.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:39.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:35:39.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:35:39.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:35:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:39.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:35:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:35:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:39.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:35:40.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:35:31' 2024-09-14T22:35:40.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:35:40.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:35:40.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:35:40.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:35:40.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:35:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:40.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:35:40.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:40.049 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:35:40.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:35:40.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:35:40.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:35:40.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:35:31' 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:35:31' 2024-09-14T22:35:40.064 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:35:40.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:35:40.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:35:40.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:40.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:40.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:40.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:40.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:40.435 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:40.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:35:40.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:35:40.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:35:31' 2024-09-14T22:35:40.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:35:40.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:35:40.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:35:31' 2024-09-14T22:35:40.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:35:40.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:35:40.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:35:40.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:35:40.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:35:40.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:35:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:35:40.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:35:40.788 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:40.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:35:40.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:35:40.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:35:40.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:35:41.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:35:41.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:35:41.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:35:41.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:35:41.801 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:35:41.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:35:41.810 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:36:22.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=14c82a250d2e74831e9b1e25771376ec 2024-09-14T22:36:22.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:36:22.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 14c82a250d2e74831e9b1e25771376ec != \1\4\c\8\2\a\2\5\0\d\2\e\7\4\8\3\1\e\9\b\1\e\2\5\7\7\1\3\7\6\e\c ]] 2024-09-14T22:36:27.954 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=5cbce8017878139a20971291542c6223 2024-09-14T22:36:27.955 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:36:28.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 5cbce8017878139a20971291542c6223 != \5\c\b\c\e\8\0\1\7\8\7\8\1\3\9\a\2\0\9\7\1\2\9\1\5\4\2\c\6\2\2\3 ]] 2024-09-14T22:36:30.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4bc8293b862c8ed546b4aacd19528b58 2024-09-14T22:36:30.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:36:30.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4bc8293b862c8ed546b4aacd19528b58 != \4\b\c\8\2\9\3\b\8\6\2\c\8\e\d\5\4\6\b\4\a\a\c\d\1\9\5\2\8\b\5\8 ]] 2024-09-14T22:36:32.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=55db0e00da5384f8b06b5a55757267a7 2024-09-14T22:36:32.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:36:32.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=8ebf76bf03c09e7b141d0aba75227b46 2024-09-14T22:36:32.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:36:32.903 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 55db0e00da5384f8b06b5a55757267a7 != \5\5\d\b\0\e\0\0\d\a\5\3\8\4\f\8\b\0\6\b\5\a\5\5\7\5\7\2\6\7\a\7 ]] 2024-09-14T22:36:32.969 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 8ebf76bf03c09e7b141d0aba75227b46 != \8\e\b\f\7\6\b\f\0\3\c\0\9\e\7\b\1\4\1\d\0\a\b\a\7\5\2\2\7\b\4\6 ]] 2024-09-14T22:36:33.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0899c61dc7c2df13b32ff8aab26fe2a1 2024-09-14T22:36:33.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:36:33.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0899c61dc7c2df13b32ff8aab26fe2a1 != \0\8\9\9\c\6\1\d\c\7\c\2\d\f\1\3\b\3\2\f\f\8\a\a\b\2\6\f\e\2\a\1 ]] 2024-09-14T22:36:33.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4283bbcc0937443acada509891038c4d 2024-09-14T22:36:33.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:36:33.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4283bbcc0937443acada509891038c4d != \4\2\8\3\b\b\c\c\0\9\3\7\4\4\3\a\c\a\d\a\5\0\9\8\9\1\0\3\8\c\4\d ]] 2024-09-14T22:36:34.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a48ccf1615cbe5bc372a0b530d080df6 2024-09-14T22:36:34.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:36:34.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a48ccf1615cbe5bc372a0b530d080df6 != \a\4\8\c\c\f\1\6\1\5\c\b\e\5\b\c\3\7\2\a\0\b\5\3\0\d\0\8\0\d\f\6 ]] 2024-09-14T22:36:34.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=48d76cf8101b0162f9eb30f5f38b4173 2024-09-14T22:36:34.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:36:34.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=89030f3446d4fd4a2b1ffe14b3e32832 2024-09-14T22:36:34.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:36:34.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 48d76cf8101b0162f9eb30f5f38b4173 != \4\8\d\7\6\c\f\8\1\0\1\b\0\1\6\2\f\9\e\b\3\0\f\5\f\3\8\b\4\1\7\3 ]] 2024-09-14T22:36:34.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 89030f3446d4fd4a2b1ffe14b3e32832 != \8\9\0\3\0\f\3\4\4\6\d\4\f\d\4\a\2\b\1\f\f\e\1\4\b\3\e\3\2\8\3\2 ]] 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138099 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138101 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138103 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138105 2024-09-14T22:36:34.552 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138107 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138109 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138111 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138113 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 138115 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:34.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:34.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:36:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: e073dddd-5851-43b6-9ecd-46c702e4eaa3 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3275161.6,"bytes_per_snapshot":65503232.0,"last_snapshot_bytes":65503232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353341,"remote_snapshot_timestamp":1726353341,"replay_state":"idle"} 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:35.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:35.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:35.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:35.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3275161.6,"bytes_per_snapshot":65503232.0,"last_snapshot_bytes":65503232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353341,"remote_snapshot_timestamp":1726353341,"replay_state":"idle"} 2024-09-14T22:36:35.654 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:35.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:35.655 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:35.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:35.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:35.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:35.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:35.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:35.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:35.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:35.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:35.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary1e073dddd-5851-43b6-9ecd-46c702e4eaa3up+replayingreplaying, {"bytes_per_second":3275161.6,"bytes_per_snapshot":65503232.0,"last_snapshot_bytes":65503232,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353341,"remote_snapshot_timestamp":1726353341,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+replayingreplaying, {"bytes_per_second":3296256.0,"bytes_per_snapshot":65925120.0,"last_snapshot_bytes":65925120,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+replayingreplaying, {"bytes_per_second":3418521.6,"bytes_per_snapshot":68370432.0,"last_snapshot_bytes":68370432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+replayingreplaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+replayingreplaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:35.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:35.789 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:36:35.794 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:35.795 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:36:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:35.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:35.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:35.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:35.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:36:35.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:36:36.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:36.017+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58b4e61a0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:36.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:36.017+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/e073dddd-5851-43b6-9ecd-46c702e4eaa3] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:37.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:37.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:37.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:36:37.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:37.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:37.689 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:38.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:38.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:38.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:38.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: b7514926-c247-4698-95b6-e5deb4ca6f53 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3296256.0,"bytes_per_snapshot":65925120.0,"last_snapshot_bytes":65925120,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:38.775 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:38.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:38.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3296256.0,"bytes_per_snapshot":65925120.0,"last_snapshot_bytes":65925120,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:38.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:38.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:38.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:38.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:38.787 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:38.792 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:38.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary2b7514926-c247-4698-95b6-e5deb4ca6f53up+replayingreplaying, {"bytes_per_second":3296256.0,"bytes_per_snapshot":65925120.0,"last_snapshot_bytes":65925120,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+replayingreplaying, {"bytes_per_second":3418521.6,"bytes_per_snapshot":68370432.0,"last_snapshot_bytes":68370432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+replayingreplaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+replayingreplaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:38.908 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:38.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:36:38.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:38.913 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:36:38.917 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:38.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:38.918 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:38.920 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:38.921 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:36:38.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:36:39.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:39.134+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a691040 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:39.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:39.134+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/b7514926-c247-4698-95b6-e5deb4ca6f53] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:40.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:40.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:36:40.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:40.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:40.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:36:40.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:40.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:40.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:36:40.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:40.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:36:40.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:40.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:36:40.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:36:40.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:40.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:41.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:41.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:41.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 28b81768-e1cc-45be-bc99-4a56d363e54d 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3418521.6,"bytes_per_snapshot":68370432.0,"last_snapshot_bytes":68370432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"} 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:41.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:41.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:41.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3418521.6,"bytes_per_snapshot":68370432.0,"last_snapshot_bytes":68370432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"} 2024-09-14T22:36:41.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:41.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:41.730 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:41.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:41.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:41.734 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:41.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:41.736 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:41.739 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:41.740 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:41.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary328b81768-e1cc-45be-bc99-4a56d363e54dup+replayingreplaying, {"bytes_per_second":3418521.6,"bytes_per_snapshot":68370432.0,"last_snapshot_bytes":68370432,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+replayingreplaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+replayingreplaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:41.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:41.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:36:41.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:41.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:36:41.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:41.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:41.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:41.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:36:41.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:41.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:41.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:41.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:36:41.935 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:36:42.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:42.086+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a767520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:42.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:42.086+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca780 [3/28b81768-e1cc-45be-bc99-4a56d363e54d] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:43.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:43.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:36:43.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:43.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:43.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:36:43.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:43.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:43.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:36:43.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:43.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:43.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:43.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:43.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:43.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:44.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:44.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:44.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:36:44.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:36:44.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 61ba40cb-45ff-4676-bd74-1a76912f49b8 2024-09-14T22:36:44.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:44.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"} 2024-09-14T22:36:44.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:44.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:44.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:44.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:44.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"} 2024-09-14T22:36:44.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:44.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:44.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:44.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:44.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:44.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:44.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:44.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:44.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary461ba40cb-45ff-4676-bd74-1a76912f49b8up+replayingreplaying, {"bytes_per_second":3114803.2,"bytes_per_snapshot":62296064.0,"last_snapshot_bytes":62296064,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353333,"remote_snapshot_timestamp":1726353333,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+replayingreplaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:44.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:44.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:36:44.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:44.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:36:44.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:44.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:44.674 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:44.676 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:36:44.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:36:44.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:44.928+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58b4e6000 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:44.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:44.928+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca000 [3/61ba40cb-45ff-4676-bd74-1a76912f49b8] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:46.550 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:46.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:46.558 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:36:46.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:46.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:46.615 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:47.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:47.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:47.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 789bf920-3cab-47b4-a559-5e298e326a86 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"} 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:47.702 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:47.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:47.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:47.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"} 2024-09-14T22:36:47.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:47.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:47.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:47.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:47.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:47.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:47.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:47.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:47.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary5789bf920-3cab-47b4-a559-5e298e326a86up+replayingreplaying, {"bytes_per_second":3207577.6,"bytes_per_snapshot":64151552.0,"last_snapshot_bytes":64151552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353338,"remote_snapshot_timestamp":1726353338,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:47.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:47.826 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:36:47.830 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:36:47.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:47.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:47.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:47.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:47.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:47.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:36:47.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:36:48.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:48.091+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d131e0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:48.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:48.091+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb900 [3/789bf920-3cab-47b4-a559-5e298e326a86] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:49.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:36:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:36:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:49.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:49.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:36:49.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:49.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:36:49.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:49.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:36:49.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:36:49.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:49.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:49.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:50.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:36:50.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:50.368 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:36:50.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:36:50.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f0ebe29-f541-419f-ae16-9257ae15a61b 2024-09-14T22:36:50.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:50.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:50.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:50.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:50.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:50.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:50.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:50.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:50.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:50.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:50.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:50.469 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:50.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:50.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:50.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:50.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:50.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:50.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:50.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary64f0ebe29-f541-419f-ae16-9257ae15a61bup+replayingreplaying, {"bytes_per_second":3197542.4,"bytes_per_snapshot":63950848.0,"last_snapshot_bytes":63950848,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:50.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:50.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:36:50.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:50.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:36:50.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:50.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:50.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:50.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:50.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:36:50.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:36:50.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:50.817+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58873c820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:50.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:50.817+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5400 [3/4f0ebe29-f541-419f-ae16-9257ae15a61b] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:52.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:52.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:52.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:36:52.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:52.370 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:36:52.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:52.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:53.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:36:53.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:53.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:36:53.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 46a5e7ce-857e-4971-9939-53e25b21406a 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"} 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:53.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:53.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:53.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:53.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"} 2024-09-14T22:36:53.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:53.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:53.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:53.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:53.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:53.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:53.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:53.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:53.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:53.472 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:53.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary746a5e7ce-857e-4971-9939-53e25b21406aup+replayingreplaying, {"bytes_per_second":3413196.8,"bytes_per_snapshot":68263936.0,"last_snapshot_bytes":68263936,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353335,"remote_snapshot_timestamp":1726353335,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:53.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:53.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:36:53.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:53.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:36:53.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:53.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:53.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:53.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:36:53.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:36:53.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:53.801+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588dccea0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:53.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:53.801+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb180 [3/46a5e7ce-857e-4971-9939-53e25b21406a] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:55.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:55.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:36:55.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:55.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:55.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:36:55.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:55.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:55.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:36:55.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:55.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:36:55.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:55.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:36:55.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:55.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:56.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:56.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:56.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:36:56.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:36:56.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 91772fca-d4c2-401c-b44e-8b834f4ecb71 2024-09-14T22:36:56.458 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:56.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:56.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:56.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:56.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:56.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:56.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:56.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:36:56.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:56.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:56.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:56.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:56.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:56.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:56.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:56.471 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:56.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:56.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:56.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:56.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:56.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary891772fca-d4c2-401c-b44e-8b834f4ecb71up+replayingreplaying, {"bytes_per_second":3269017.6,"bytes_per_snapshot":65380352.0,"last_snapshot_bytes":65380352,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:56.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:36:56.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:56.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:36:56.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:56.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:36:56.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:36:56.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:56.805+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588b2e340 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:56.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:56.805+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4f00 [3/91772fca-d4c2-401c-b44e-8b834f4ecb71] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:36:58.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:36:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:36:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:36:58.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:58.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:36:58.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:36:58.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:58.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:58.361 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:36:58.362 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:36:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:36:59.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:59.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:36:59.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:36:59.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: fedb0eca-8a3f-4820-9146-baf9cc58de80 2024-09-14T22:36:59.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:36:59.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"} 2024-09-14T22:36:59.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:36:59.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:36:31' 2024-09-14T22:36:59.449 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:36:59.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:36:59.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:36:59.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"} 2024-09-14T22:36:59.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:36:59.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:59.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:36:59.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:59.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:36:59.459 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:36:59.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:36:59.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:36:59.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:59.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:36:31' 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:36:31' 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:36:59.465 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:36:59.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":3204505.6,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31image-primary9fedb0eca-8a3f-4820-9146-baf9cc58de80up+replayingreplaying, {"bytes_per_second":3260416.0,"bytes_per_snapshot":65208320.0,"last_snapshot_bytes":65208320,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353340,"remote_snapshot_timestamp":1726353340,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:36:31' 2024-09-14T22:36:59.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:36:59.557 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:36:59.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:36:31' 2024-09-14T22:36:59.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:36:59.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:36:59.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:36:59.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:36:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:36:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:36:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:36:59.633 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:36:59.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:59.782+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588c65520 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:36:59.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:36:59.782+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb680 [3/fedb0eca-8a3f-4820-9146-baf9cc58de80] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:37:01.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:37:01.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:37:01.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:01.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:01.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:01.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:37:01.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:37:01.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:37:01.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:01.398 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:01.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:37:01.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:37:01.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:37:01.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:37:01.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:37:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:37:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:02.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:37:02.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:37:02.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:37:02.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:37:02.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:37:02.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:37:02.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:37:02.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 0a70a2ca-4195-439e-89d8-a7aed6e21451 2024-09-14T22:37:02.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:37:02.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:37:02.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:37:02.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:37:01' 2024-09-14T22:37:02.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:37:02.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:37:02.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:37:02.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"} 2024-09-14T22:37:02.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:37:02.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:37:02.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:37:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:37:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:37:02.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:37:02.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:37:02.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:37:01' 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:37:01' 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:02.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:37:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:37:01' 2024-09-14T22:37:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:37:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:37:02.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:37:02.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary100a70a2ca-4195-439e-89d8-a7aed6e21451up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":64090112.0,"last_snapshot_bytes":64090112,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353339,"remote_snapshot_timestamp":1726353339,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:37:01' 2024-09-14T22:37:02.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:37:02.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:37:02.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:37:01' 2024-09-14T22:37:02.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:37:02.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:37:02.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:37:02.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:37:02.599 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:02.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:02.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:37:02.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:37:02.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:37:02.823+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588b2f380 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:37:02.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:37:02.824+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b589719180 [3/0a70a2ca-4195-439e-89d8-a7aed6e21451] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:37:04.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:37:04.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:37:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:37:04.453 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:37:04.454 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:37:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:37:04.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..10} 2024-09-14T22:37:04.514 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS=() 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS=() 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS=() 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS=() 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ RET=0 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary1 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary1 snapshot 10G 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary1 10G 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:04.516 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:04.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:04.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary1 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary1 snapshot 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:04.594 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary1 snapshot 2024-09-14T22:37:05.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:05.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary1 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary1': 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3c735fee52d 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3c735fee52d 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:04 2024 2024-09-14T22:37:05.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:04 2024 2024-09-14T22:37:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:04 2024 2024-09-14T22:37:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:37:05.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:05.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:05.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:05.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary1 2024-09-14T22:37:05.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd0 2024-09-14T22:37:05.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:05.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd0 2024-09-14T22:37:05.337 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:05.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:05.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:05.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: dcfee47a-4372-4edf-8188-448f0b4c006a 2024-09-14T22:37:05.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:05.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:05.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:05.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:05.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:05.354 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:05.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:05.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:05.425 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary1 2024-09-14T22:37:05.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd0 test-primary1 2024-09-14T22:37:05.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:05.510 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:05.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:05.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:37:05.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary2 2024-09-14T22:37:05.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary2 snapshot 10G 2024-09-14T22:37:05.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary1 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:05.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary2 10G 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary1 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:05.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:05.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary1 2024-09-14T22:37:05.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary2 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary2 snapshot 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:05.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary2 snapshot 2024-09-14T22:37:05.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:05.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary1/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary1' 2024-09-14T22:37:06.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:06.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2974 2024-09-14T22:37:06.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary2 2024-09-14T22:37:06.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary2': 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3c8360e22b4e 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3c8360e22b4e 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:06.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:05 2024 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:05 2024 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:05 2024 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:37:06.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:06.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:06.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:06.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary2 2024-09-14T22:37:06.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd1 2024-09-14T22:37:06.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:06.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd1 2024-09-14T22:37:06.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:06.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:06.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 30de5d61-123c-439b-9fb1-b27383994ebb 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:06.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:06.339 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:06.397 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:06.399 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary2 2024-09-14T22:37:06.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd1 test-primary2 2024-09-14T22:37:06.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:06.466 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary2 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary2 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:06.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary2 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:37:06.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary3 2024-09-14T22:37:06.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary3 snapshot 10G 2024-09-14T22:37:06.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary2 2024-09-14T22:37:06.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary2 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary3 10G 2024-09-14T22:37:06.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:06.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary3 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary3 snapshot 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:06.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary3 snapshot 2024-09-14T22:37:06.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:06.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary2/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary2' 2024-09-14T22:37:07.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:07.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2976 2024-09-14T22:37:07.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:07.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary3 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary3': 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3c91fcdee47b 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3c91fcdee47b 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:07.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:06 2024 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:06 2024 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:06 2024 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:37:07.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:07.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:07.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:07.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary3 2024-09-14T22:37:07.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd2 2024-09-14T22:37:07.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:07.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd2 2024-09-14T22:37:07.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: cb8a1ecf-a039-4df2-a10d-424f4e849689 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:07.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:07.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:07.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:07.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary3 2024-09-14T22:37:07.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd2 test-primary3 2024-09-14T22:37:07.475 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:07.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary3 2024-09-14T22:37:07.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:07.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary3 2024-09-14T22:37:07.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary4 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary3 2024-09-14T22:37:07.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary4 snapshot 10G 2024-09-14T22:37:07.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:07.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary4 10G 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary3 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:07.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary3 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary4 2024-09-14T22:37:07.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary4 snapshot 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:07.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary4 snapshot 2024-09-14T22:37:07.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:07.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary3/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary3' 2024-09-14T22:37:08.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:08.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2978 2024-09-14T22:37:08.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:08.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary4 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary4': 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3ca022e87c5d 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3ca022e87c5d 2024-09-14T22:37:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:07 2024 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:07 2024 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:07 2024 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:37:08.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:08.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:08.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:08.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary4 2024-09-14T22:37:08.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd3 2024-09-14T22:37:08.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:08.347 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd3 2024-09-14T22:37:08.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 3b2ace54-8815-43fa-82fe-05e4bd90e134 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:08.381 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:08.386 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:08.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:08.445 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:08.448 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary4 2024-09-14T22:37:08.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd3 test-primary4 2024-09-14T22:37:08.511 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:08.513 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary4 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary4 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:08.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:08.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:08.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:08.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:37:08.540 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary5 2024-09-14T22:37:08.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary4 2024-09-14T22:37:08.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary5 snapshot 10G 2024-09-14T22:37:08.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:08.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary4 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary5 10G 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary4 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:08.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:08.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary5 2024-09-14T22:37:08.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:08.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:08.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary5 snapshot 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:08.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary5 snapshot 2024-09-14T22:37:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:08.883 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary4/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary4' 2024-09-14T22:37:09.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:09.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:09.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:09.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:09.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:09.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2980 2024-09-14T22:37:09.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:09.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary5 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary5': 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3cafbf5ecd75 2024-09-14T22:37:09.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3cafbf5ecd75 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:08 2024 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:08 2024 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:08 2024 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:37:09.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:09.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:09.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:09.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary5 2024-09-14T22:37:09.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd4 2024-09-14T22:37:09.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:09.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd4 2024-09-14T22:37:09.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:09.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:09.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:09.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 917acb32-8ffa-4115-bfc0-b031d1e00d33 2024-09-14T22:37:09.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:09.543 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:09.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:09.651 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:09.653 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary5 2024-09-14T22:37:09.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd4 test-primary5 2024-09-14T22:37:09.735 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary5 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary5 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary5 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary6 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary6 snapshot 10G 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:09.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary5 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary5 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary6 10G 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:09.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary6 2024-09-14T22:37:09.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary6 snapshot 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:09.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary6 snapshot 2024-09-14T22:37:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:10.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:10.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:10.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary5/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary5' 2024-09-14T22:37:10.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:10.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2982 2024-09-14T22:37:10.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2983 2024-09-14T22:37:10.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:10.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary6 2024-09-14T22:37:10.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary6': 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3cc04b75cc56 2024-09-14T22:37:10.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3cc04b75cc56 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:09 2024 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:09 2024 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:09 2024 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:37:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:10.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:10.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary6 2024-09-14T22:37:10.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd5 2024-09-14T22:37:10.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:10.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd5 2024-09-14T22:37:10.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 34da1cda-4c0f-4797-8c48-c7ebcfa7c8f8 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:10.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:10.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:10.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:10.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:10.726 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary6 2024-09-14T22:37:10.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd5 test-primary6 2024-09-14T22:37:10.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:10.827 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary6 2024-09-14T22:37:10.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:10.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary7 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary6 2024-09-14T22:37:10.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary7 snapshot 10G 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary6 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary7 10G 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary6 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:10.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary7 2024-09-14T22:37:10.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:10.957 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary7 snapshot 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:10.958 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary7 snapshot 2024-09-14T22:37:11.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:11.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:11.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:11.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:11.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:11.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:11.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2986 2024-09-14T22:37:11.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2985 2024-09-14T22:37:11.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:11.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:11.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary6/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary6' 2024-09-14T22:37:12.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:12.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2988 2024-09-14T22:37:12.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary7 2024-09-14T22:37:12.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:12.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:12.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:12.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:12.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary7': 2024-09-14T22:37:12.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:12.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:12.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3cd1cb6afa84 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3cd1cb6afa84 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:10 2024 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:10 2024 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:10 2024 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:37:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:12.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary7 2024-09-14T22:37:12.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd6 2024-09-14T22:37:12.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:12.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd6 2024-09-14T22:37:12.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:12.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:12.492 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: 141d811c-186b-4bd4-95da-3b15a3c11465 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:12.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:12.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:12.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:12.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:12.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary7 2024-09-14T22:37:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd6 test-primary7 2024-09-14T22:37:12.743 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:12.745 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary7 2024-09-14T22:37:12.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary7 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:12.770 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary8 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary8 snapshot 10G 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary7 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:12.771 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary8 10G 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary7 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary7 2024-09-14T22:37:12.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary8 2024-09-14T22:37:12.855 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary8 snapshot 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:12.856 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary8 snapshot 2024-09-14T22:37:13.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2990 2024-09-14T22:37:13.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:13.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:13.084 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary7/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary7' 2024-09-14T22:37:13.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2989 2024-09-14T22:37:13.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary8 2024-09-14T22:37:13.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:13.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:13.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:13.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:13.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:13.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:13.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:13.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary8': 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3ce4906932ad 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3ce4906932ad 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:12 2024 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:12 2024 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:12 2024 2024-09-14T22:37:13.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:13.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:13.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:37:13.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:13.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:13.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:13.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary8 2024-09-14T22:37:13.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd7 2024-09-14T22:37:13.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:13.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd7 2024-09-14T22:37:13.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:13.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: b5aa26bb-ea84-453f-a1be-6c68b94701f5 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:13.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:13.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:13.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:13.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:13.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary8 2024-09-14T22:37:13.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd7 test-primary8 2024-09-14T22:37:13.776 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:13.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary8 2024-09-14T22:37:13.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:13.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary8 2024-09-14T22:37:13.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary9 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary9 snapshot 10G 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary8 2024-09-14T22:37:13.804 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary9 10G 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.805 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary8 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary9 2024-09-14T22:37:13.806 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary8 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary9 snapshot 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:13.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary9 snapshot 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:14.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:14.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:14.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:14.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:14.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:14.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:14.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:14.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:15.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary9 2024-09-14T22:37:15.419 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2994 2024-09-14T22:37:15.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2993 2024-09-14T22:37:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2992 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary9': 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3cf8e83ac202 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3cf8e83ac202 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:15.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:13 2024 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:13 2024 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:13 2024 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:37:15.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary9 2024-09-14T22:37:15.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:15.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:15.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:15.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:15.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary8/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary8' 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:16.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:16.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2997 2024-09-14T22:37:16.535 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2998 2024-09-14T22:37:16.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2996 2024-09-14T22:37:16.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:16.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd8 2024-09-14T22:37:16.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:16.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd8 2024-09-14T22:37:16.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:16.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:16.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: cf5794c2-1e10-42f2-84f6-723aa3470aed 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:16.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:16.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:16.782 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:16.786 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:16.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:16.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary9 2024-09-14T22:37:16.861 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd8 test-primary9 2024-09-14T22:37:16.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:16.933 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary9 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary9 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.959 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ MNTPT=test-primary10 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image_and_enable_mirror cluster1 mirror image-primary10 snapshot 10G 2024-09-14T22:37:16.960 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary9 2024-09-14T22:37:16.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.961 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n snapshot ']' 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ create_image cluster1 mirror image-primary10 10G 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary9 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary9 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:16.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local size=128 2024-09-14T22:37:16.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n 10G ']' 2024-09-14T22:37:16.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ size=10G 2024-09-14T22:37:16.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ shift 2024-09-14T22:37:16.963 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 create --size 10G --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image-primary10 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ is_pool_mirror_mode_image mirror 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' image = image ']' 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ enable_mirror cluster1 mirror image-primary10 snapshot 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mode=snapshot 2024-09-14T22:37:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image enable mirror/image-primary10 snapshot 2024-09-14T22:37:17.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:17.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary9/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary9' 2024-09-14T22:37:17.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Mirroring enabled 2024-09-14T22:37:17.532 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3001 2024-09-14T22:37:17.545 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 info mirror/image-primary10 2024-09-14T22:37:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3000 2024-09-14T22:37:17.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 2999 2024-09-14T22:37:17.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:17.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:rbd image 'image-primary10': 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: size 10 GiB in 2560 objects 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: order 22 (4 MiB objects) 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: snapshot_count: 1 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: id: 3d1516b86524 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: block_name_prefix: rbd_data.3d1516b86524 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: format: 2 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: features: layering, exclusive-lock, object-map, fast-diff 2024-09-14T22:37:17.668 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: op_features: 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: flags: 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: create_timestamp: Sat Sep 14 22:37:17 2024 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: access_timestamp: Sat Sep 14 22:37:17 2024 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: modify_timestamp: Sat Sep 14 22:37:17 2024 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring state: enabled 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring mode: snapshot 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring global id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:37:17.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: mirroring primary: true 2024-09-14T22:37:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:37:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:37:17.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster1 device map -t krbd mirror/image-primary10 2024-09-14T22:37:18.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEV=/dev/rbd9 2024-09-14T22:37:18.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ DEVS+=($DEV) 2024-09-14T22:37:18.044 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mkfs.ext4 /dev/rbd9 2024-09-14T22:37:18.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Discarding device blocks: 0/2621440 done 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating filesystem with 2621440 4k blocks and 655360 inodes 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Filesystem UUID: a14a660f-4f94-436b-8f7d-89f2ad6271de 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Superblock backups stored on blocks: 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Allocating group tables: 0/80 done 2024-09-14T22:37:18.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing inode tables: 0/80 done 2024-09-14T22:37:18.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Creating journal (16384 blocks): done 2024-09-14T22:37:18.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Writing superblocks and filesystem accounting information: 0/80 done 2024-09-14T22:37:18.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: 2024-09-14T22:37:18.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mkdir test-primary10 2024-09-14T22:37:18.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo mount /dev/rbd9 test-primary10 2024-09-14T22:37:18.401 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ whoami 2024-09-14T22:37:18.403 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo chown ubuntu test-primary10 2024-09-14T22:37:18.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ SNAP_PIDS+=($!) 2024-09-14T22:37:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ WORKLOAD_PIDS+=($!) 2024-09-14T22:37:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:37:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ slow_untar_workload test-primary10 2024-09-14T22:37:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142633 2024-09-14T22:37:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mountpt=test-primary10 2024-09-14T22:37:18.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cp linux-5.4.tar.gz test-primary10 2024-09-14T22:37:18.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ take_mirror_snapshots cluster1 mirror image-primary10 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:18.443 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:18.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:18.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:18.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local ret=0 2024-09-14T22:37:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ timeout 5m bash -c 'zcat test-primary10/linux-5.4.tar.gz | pv -L 256K | tar xf - -C test-primary10' 2024-09-14T22:37:19.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3006 2024-09-14T22:37:19.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3005 2024-09-14T22:37:19.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3004 2024-09-14T22:37:19.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3003 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:19.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:19.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:19.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:19.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:19.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:19.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:20.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3008 2024-09-14T22:37:20.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:20.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:20.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3009 2024-09-14T22:37:20.609 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3007 2024-09-14T22:37:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:20.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:20.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:20.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:20.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:20.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:20.624 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:20.625 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:20.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:20.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:20.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:21.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3011 2024-09-14T22:37:21.515 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3012 2024-09-14T22:37:21.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3010 2024-09-14T22:37:21.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:21.536 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:21.538 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:22.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:22.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:22.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:22.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:22.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:22.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:22.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:22.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:22.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:23.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3014 2024-09-14T22:37:23.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3015 2024-09-14T22:37:23.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3013 2024-09-14T22:37:23.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3016 2024-09-14T22:37:23.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:23.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:23.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:23.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:23.628 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:23.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:23.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:23.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:23.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:23.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:23.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:23.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:23.669 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:23.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:23.672 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:23.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:23.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:23.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:23.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:23.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:24.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3018 2024-09-14T22:37:24.083 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3019 2024-09-14T22:37:24.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3017 2024-09-14T22:37:24.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:24.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:24.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:24.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:24.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:24.541 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:24.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:25.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3021 2024-09-14T22:37:25.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3020 2024-09-14T22:37:25.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3022 2024-09-14T22:37:25.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:25.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:25.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:26.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:26.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:27.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:27.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:27.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:27.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:27.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:27.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:27.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:27.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:27.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:27.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:27.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:27.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:27.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:27.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3023 2024-09-14T22:37:27.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3024 2024-09-14T22:37:27.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:27.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:27.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3025 2024-09-14T22:37:27.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:28.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:28.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:28.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3029 2024-09-14T22:37:28.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:29.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3026 2024-09-14T22:37:29.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3027 2024-09-14T22:37:29.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3028 2024-09-14T22:37:29.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3030 2024-09-14T22:37:29.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:29.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:29.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:29.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:29.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3031 2024-09-14T22:37:29.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:30.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3032 2024-09-14T22:37:30.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:30.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:30.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:30.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:30.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:31.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3033 2024-09-14T22:37:31.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3034 2024-09-14T22:37:31.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:31.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:31.272 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:31.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:31.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:31.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:31.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:31.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:32.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:32.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:32.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:32.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:32.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:32.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:32.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:32.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:32.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:32.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:32.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:32.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:32.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:32.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:32.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:32.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:32.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:32.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:32.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:32.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:32.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:33.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3035 2024-09-14T22:37:33.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:33.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:33.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:33.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:33.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:33.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:33.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:33.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3037 2024-09-14T22:37:33.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3040 2024-09-14T22:37:33.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:34.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3036 2024-09-14T22:37:34.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:34.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:34.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:34.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:34.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:34.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:34.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:34.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3041 2024-09-14T22:37:34.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:34.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:34.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:34.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:34.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:34.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:34.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3039 2024-09-14T22:37:34.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:34.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:35.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3038 2024-09-14T22:37:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:35.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3042 2024-09-14T22:37:35.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:35.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3043 2024-09-14T22:37:35.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:36.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:36.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:36.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:36.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:36.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:36.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:36.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:36.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:36.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:36.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:37.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3044 2024-09-14T22:37:37.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:37.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:37.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:37.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:37.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:37.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:37.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:37.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:37.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3045 2024-09-14T22:37:37.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:38.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:38.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:38.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:38.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3048 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:38.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:38.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:39.114 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3047 2024-09-14T22:37:39.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3046 2024-09-14T22:37:39.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3050 2024-09-14T22:37:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:39.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:39.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:39.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3049 2024-09-14T22:37:39.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:39.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3051 2024-09-14T22:37:39.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:40.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3052 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:40.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:40.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3053 2024-09-14T22:37:40.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:40.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:40.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:40.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:40.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:40.276 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:40.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:41.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3054 2024-09-14T22:37:41.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:41.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:41.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:41.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:41.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:41.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:41.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:42.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:42.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:42.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:42.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:42.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:42.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:42.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:42.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:42.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:42.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:43.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3055 2024-09-14T22:37:43.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:43.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3057 2024-09-14T22:37:43.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3058 2024-09-14T22:37:43.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:43.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:43.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:43.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:43.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:43.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:43.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:43.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:43.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:44.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3056 2024-09-14T22:37:44.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:44.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:44.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:44.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:44.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:44.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:44.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:44.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3059 2024-09-14T22:37:44.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3060 2024-09-14T22:37:44.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:44.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:45.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3061 2024-09-14T22:37:45.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3062 2024-09-14T22:37:45.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:45.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3063 2024-09-14T22:37:45.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:45.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:46.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:46.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:46.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:46.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:46.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:46.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:46.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:46.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:46.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:46.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:46.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:46.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:46.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:46.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3064 2024-09-14T22:37:46.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:47.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:47.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:47.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:47.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:47.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:47.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:47.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:47.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:47.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:47.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:47.270 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:47.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3065 2024-09-14T22:37:47.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:48.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3067 2024-09-14T22:37:48.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:48.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3069 2024-09-14T22:37:48.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:48.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:48.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:48.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:48.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:48.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:48.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:48.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:48.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:49.062 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3066 2024-09-14T22:37:49.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:49.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3072 2024-09-14T22:37:49.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:49.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:49.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:49.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:49.300 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:49.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:49.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:50.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3068 2024-09-14T22:37:50.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3070 2024-09-14T22:37:50.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:50.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:50.326 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:51.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3073 2024-09-14T22:37:51.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3071 2024-09-14T22:37:51.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:51.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:51.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:51.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:51.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:51.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:51.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:51.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:51.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:51.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:51.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:51.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:51.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:51.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:52.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3074 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:52.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:53.045 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3075 2024-09-14T22:37:53.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:53.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:53.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:53.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:53.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:53.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:53.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:53.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:53.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:53.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:53.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:53.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:53.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:53.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3078 2024-09-14T22:37:53.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:54.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3076 2024-09-14T22:37:54.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3077 2024-09-14T22:37:54.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:54.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:54.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:54.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:54.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:54.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:54.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:54.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:54.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:54.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:54.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:54.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:54.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:54.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:54.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3081 2024-09-14T22:37:54.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3080 2024-09-14T22:37:54.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:55.098 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3079 2024-09-14T22:37:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:55.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:55.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:55.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3082 2024-09-14T22:37:55.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3083 2024-09-14T22:37:55.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:55.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:56.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:37:56.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3084 2024-09-14T22:37:56.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:56.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:56.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:37:56.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:56.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:56.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:37:56.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:37:57.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:57.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:37:57.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:57.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:57.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:37:57.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3085 2024-09-14T22:37:57.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:37:57.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:37:57.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:37:58.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3087 2024-09-14T22:37:58.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3088 2024-09-14T22:37:58.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:58.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:37:58.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:37:58.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:58.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:37:58.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:58.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:58.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:37:58.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:37:58.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:37:59.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3086 2024-09-14T22:37:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:37:59.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3091 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:37:59.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:37:59.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:00.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3089 2024-09-14T22:38:00.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3090 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:00.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:00.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3092 2024-09-14T22:38:00.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:00.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:00.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:00.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3093 2024-09-14T22:38:00.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:01.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3094 2024-09-14T22:38:01.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:01.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:01.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:01.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:01.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:01.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:01.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:01.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:02.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:02.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:02.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:03.065 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3095 2024-09-14T22:38:03.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:03.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3096 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:03.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:03.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:03.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:03.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:03.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:03.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:03.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:03.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:03.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:03.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3098 2024-09-14T22:38:03.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:04.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3097 2024-09-14T22:38:04.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:04.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:04.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:04.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3103 2024-09-14T22:38:04.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:04.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3101 2024-09-14T22:38:04.346 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:05.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3099 2024-09-14T22:38:05.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:05.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3102 2024-09-14T22:38:05.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3100 2024-09-14T22:38:05.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:05.298 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:06.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3104 2024-09-14T22:38:06.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:06.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:06.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:06.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:06.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:06.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:07.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3105 2024-09-14T22:38:07.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:07.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:07.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:07.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:08.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3108 2024-09-14T22:38:08.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:08.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:08.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:08.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:09.078 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3106 2024-09-14T22:38:09.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3107 2024-09-14T22:38:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:09.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:09.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3111 2024-09-14T22:38:09.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:09.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:09.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:09.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:09.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:09.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:09.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:10.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3109 2024-09-14T22:38:10.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3110 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:10.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:10.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:11.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:11.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3112 2024-09-14T22:38:11.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3113 2024-09-14T22:38:11.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:11.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3114 2024-09-14T22:38:11.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:11.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:12.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:12.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:12.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:12.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:12.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3115 2024-09-14T22:38:12.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:13.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3118 2024-09-14T22:38:13.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:13.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3117 2024-09-14T22:38:13.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:13.204 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:14.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3116 2024-09-14T22:38:14.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:14.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:14.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:14.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:14.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:14.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3121 2024-09-14T22:38:14.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3120 2024-09-14T22:38:14.267 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:14.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:15.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3119 2024-09-14T22:38:15.203 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:15.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3123 2024-09-14T22:38:15.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:15.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3122 2024-09-14T22:38:15.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:16.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:16.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:16.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:16.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:16.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:16.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:16.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:16.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:16.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:16.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:16.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:16.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:17.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3124 2024-09-14T22:38:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:17.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:17.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:17.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:17.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:17.283 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:17.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:17.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:17.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:17.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:17.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:17.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:18.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3125 2024-09-14T22:38:18.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:18.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3128 2024-09-14T22:38:18.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:18.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:18.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:18.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:18.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:18.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:19.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3126 2024-09-14T22:38:19.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3127 2024-09-14T22:38:19.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:19.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:19.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3130 2024-09-14T22:38:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:19.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3131 2024-09-14T22:38:19.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:20.056 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3129 2024-09-14T22:38:20.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:20.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3133 2024-09-14T22:38:20.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:20.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:21.063 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3132 2024-09-14T22:38:21.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:21.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3134 2024-09-14T22:38:21.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:21.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:21.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:21.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:21.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:21.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:21.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:21.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:21.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:21.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:21.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:21.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:21.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:22.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3135 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:22.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:22.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:22.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:22.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:22.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:22.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:22.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:22.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:22.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:22.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:23.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:23.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:23.104 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:23.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:23.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:23.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:23.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3137 2024-09-14T22:38:23.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:23.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3138 2024-09-14T22:38:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:23.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:24.074 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3136 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:24.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:24.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:24.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:24.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3141 2024-09-14T22:38:24.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:25.067 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3139 2024-09-14T22:38:25.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3140 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:25.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:25.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:25.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:25.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3143 2024-09-14T22:38:25.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:26.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3142 2024-09-14T22:38:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:26.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:26.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:26.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:26.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:26.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:26.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:26.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:27.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3144 2024-09-14T22:38:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:27.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:27.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:27.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:27.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:27.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:27.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:27.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:28.079 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3145 2024-09-14T22:38:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:28.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:28.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:28.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:28.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3148 2024-09-14T22:38:28.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:29.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:29.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3147 2024-09-14T22:38:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3146 2024-09-14T22:38:29.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:29.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:29.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3151 2024-09-14T22:38:29.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3150 2024-09-14T22:38:29.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:29.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:30.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3149 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:30.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:30.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:30.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3153 2024-09-14T22:38:30.177 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:31.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3152 2024-09-14T22:38:31.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:31.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:31.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3154 2024-09-14T22:38:31.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:31.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:32.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3155 2024-09-14T22:38:32.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:32.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:32.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:32.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:32.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:32.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:32.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:32.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:32.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:33.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:33.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:33.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:33.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:33.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:33.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3157 2024-09-14T22:38:33.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3158 2024-09-14T22:38:33.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:33.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:33.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:33.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:33.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:33.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:33.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:33.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:34.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3156 2024-09-14T22:38:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:34.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:34.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:34.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:34.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3161 2024-09-14T22:38:34.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:35.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3160 2024-09-14T22:38:35.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3159 2024-09-14T22:38:35.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:35.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:35.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:35.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3163 2024-09-14T22:38:35.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:36.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3162 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:36.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:36.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:36.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:37.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3164 2024-09-14T22:38:37.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:37.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:37.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:37.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:37.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:37.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:37.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:37.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:38.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3165 2024-09-14T22:38:38.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:38.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:38.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3168 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:38.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:38.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:38.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:38.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:38.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:38.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:38.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3166 2024-09-14T22:38:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3167 2024-09-14T22:38:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:39.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:39.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:39.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:39.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:39.229 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3171 2024-09-14T22:38:39.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3170 2024-09-14T22:38:39.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:39.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:40.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3169 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:40.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:40.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:40.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3172 2024-09-14T22:38:40.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:40.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3173 2024-09-14T22:38:40.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:41.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:41.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3174 2024-09-14T22:38:41.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:41.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:41.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:41.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:41.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:41.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:41.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:42.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3175 2024-09-14T22:38:42.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:42.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:42.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:42.218 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:42.253 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:42.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:43.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3176 2024-09-14T22:38:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:43.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3177 2024-09-14T22:38:43.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3178 2024-09-14T22:38:43.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:43.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:43.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:43.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:43.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:43.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:43.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:43.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:43.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:43.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:43.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:43.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:43.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:43.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:43.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:43.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:43.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:43.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:43.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:43.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:44.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:44.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3181 2024-09-14T22:38:44.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:45.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3179 2024-09-14T22:38:45.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3180 2024-09-14T22:38:45.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:45.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:45.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:45.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3182 2024-09-14T22:38:45.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3183 2024-09-14T22:38:45.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:45.271 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:46.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:46.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:46.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:46.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:46.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:46.122 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:46.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:46.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:46.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3184 2024-09-14T22:38:46.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:47.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3185 2024-09-14T22:38:47.217 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:47.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:47.286 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:48.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3187 2024-09-14T22:38:48.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3188 2024-09-14T22:38:48.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:48.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:48.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3186 2024-09-14T22:38:48.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:48.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:48.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:48.246 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:48.268 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:48.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:48.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:48.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:48.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:48.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:48.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:48.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:48.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:48.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:48.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:48.275 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:49.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:49.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3190 2024-09-14T22:38:49.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3191 2024-09-14T22:38:49.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:49.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:50.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3189 2024-09-14T22:38:50.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:50.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:50.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:50.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:50.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:50.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:50.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:50.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3193 2024-09-14T22:38:50.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3192 2024-09-14T22:38:50.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:50.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:51.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:51.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:51.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:51.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:51.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:51.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:51.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:51.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:51.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:51.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:51.245 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3194 2024-09-14T22:38:51.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:52.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3195 2024-09-14T22:38:52.249 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:52.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:52.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:52.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:52.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:52.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:52.279 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:52.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:52.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:53.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3196 2024-09-14T22:38:53.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3197 2024-09-14T22:38:53.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3198 2024-09-14T22:38:53.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:53.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:53.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:53.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:53.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:53.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:53.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:53.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:54.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3201 2024-09-14T22:38:54.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:54.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:54.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:38:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:38:54.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:38:55.076 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3199 2024-09-14T22:38:55.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3200 2024-09-14T22:38:55.112 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:55.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:38:55.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:38:56.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3202 2024-09-14T22:38:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3203 2024-09-14T22:38:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:56.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:38:56.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:38:56.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:38:56.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:56.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:38:56.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:56.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:56.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:38:56.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:38:57.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3204 2024-09-14T22:38:57.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:38:57.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:38:58.077 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3205 2024-09-14T22:38:58.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:58.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:38:58.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:58.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:58.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:38:58.116 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:38:58.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:58.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:58.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:38:58.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:58.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:58.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:38:58.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:38:59.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3208 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:38:59.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:38:59.115 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3207 2024-09-14T22:38:59.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:38:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:38:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:38:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:38:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:38:59.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:38:59.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3206 2024-09-14T22:38:59.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:59.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:59.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:59.230 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3211 2024-09-14T22:38:59.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3210 2024-09-14T22:38:59.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:38:59.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:00.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3209 2024-09-14T22:39:00.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:00.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:00.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:00.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:00.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:00.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:00.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:00.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3213 2024-09-14T22:39:00.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3212 2024-09-14T22:39:00.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:00.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:01.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3214 2024-09-14T22:39:01.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:01.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:01.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:01.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:01.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:01.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3215 2024-09-14T22:39:02.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:02.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:02.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:02.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:02.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:02.269 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:02.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:02.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:02.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:02.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:02.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:02.292 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:03.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3218 2024-09-14T22:39:03.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3217 2024-09-14T22:39:03.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:03.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3216 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:03.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:03.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:03.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:03.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:03.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:03.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:03.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:03.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:03.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:03.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:04.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:04.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:04.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:04.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:04.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:04.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:04.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3221 2024-09-14T22:39:04.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:05.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3219 2024-09-14T22:39:05.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3220 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:05.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:05.159 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:05.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:06.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3223 2024-09-14T22:39:06.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:06.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3222 2024-09-14T22:39:06.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:06.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:06.169 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:06.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:06.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:07.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3224 2024-09-14T22:39:07.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:07.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:08.070 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3225 2024-09-14T22:39:08.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:08.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:08.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:08.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:08.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:08.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:08.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:08.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:08.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:08.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:08.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:09.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3226 2024-09-14T22:39:09.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3228 2024-09-14T22:39:09.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3227 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:09.172 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:09.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:09.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:09.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:09.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3230 2024-09-14T22:39:09.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3231 2024-09-14T22:39:09.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:09.262 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:10.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3229 2024-09-14T22:39:10.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:10.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3232 2024-09-14T22:39:10.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3233 2024-09-14T22:39:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:10.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:10.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:10.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:10.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:11.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:11.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:11.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:11.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:11.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:11.109 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:11.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3234 2024-09-14T22:39:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:12.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3235 2024-09-14T22:39:12.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:12.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:12.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:12.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:12.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:12.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:12.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:12.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:12.265 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:13.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3238 2024-09-14T22:39:13.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3236 2024-09-14T22:39:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3237 2024-09-14T22:39:13.134 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:13.140 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:13.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:13.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:13.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:13.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:14.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:14.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:14.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:14.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:14.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:14.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:14.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3241 2024-09-14T22:39:14.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:15.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3240 2024-09-14T22:39:15.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3239 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:15.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:15.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:16.137 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:16.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:16.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:16.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:16.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:16.143 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:16.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:16.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:16.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:16.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:16.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:16.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:16.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:16.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3242 2024-09-14T22:39:16.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3243 2024-09-14T22:39:16.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:16.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:17.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3244 2024-09-14T22:39:17.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:17.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:17.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:17.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:17.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:17.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:17.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:18.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3245 2024-09-14T22:39:18.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:18.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:18.222 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:18.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:19.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3247 2024-09-14T22:39:19.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3246 2024-09-14T22:39:19.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3248 2024-09-14T22:39:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:19.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:19.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:19.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:19.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:19.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:19.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:19.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3251 2024-09-14T22:39:19.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3250 2024-09-14T22:39:19.327 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:19.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:20.180 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3249 2024-09-14T22:39:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:20.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:20.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:20.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:20.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:20.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3252 2024-09-14T22:39:20.235 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3253 2024-09-14T22:39:20.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:20.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:21.133 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:21.232 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3254 2024-09-14T22:39:21.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:22.219 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3255 2024-09-14T22:39:22.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:22.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:22.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:22.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:22.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:22.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:22.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:22.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:22.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:22.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:22.333 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:22.334 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:23.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3258 2024-09-14T22:39:23.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3256 2024-09-14T22:39:23.130 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3257 2024-09-14T22:39:23.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:23.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:23.141 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:23.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:23.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:23.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:23.258 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:23.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:23.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:23.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:23.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:24.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3261 2024-09-14T22:39:24.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:24.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:25.066 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3259 2024-09-14T22:39:25.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3260 2024-09-14T22:39:25.121 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:25.123 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:25.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:26.085 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3263 2024-09-14T22:39:26.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3262 2024-09-14T22:39:26.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:26.132 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:26.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:26.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:26.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:26.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:26.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:26.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:26.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:26.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:26.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:26.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:26.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:26.139 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary1 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:39:26.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary1 2024-09-14T22:39:27.081 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3264 2024-09-14T22:39:27.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:27.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:27.174 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:27.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:27.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:27.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:27.175 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:28.091 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3265 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary3 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:39:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary3 2024-09-14T22:39:28.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:28.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary2 2024-09-14T22:39:28.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:28.125 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:28.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:39:28.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary2 2024-09-14T22:39:28.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.097 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3268 2024-09-14T22:39:29.106 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3266 2024-09-14T22:39:29.119 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3267 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary4 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:39:29.135 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary4 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:29.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:29.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3269 2024-09-14T22:39:29.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3271 2024-09-14T22:39:29.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3270 2024-09-14T22:39:29.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:29.261 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:30.127 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3273 2024-09-14T22:39:30.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3272 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:30.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:30.144 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:30.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary5 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary5 2024-09-14T22:39:31.138 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3274 2024-09-14T22:39:31.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:32.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3275 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary6 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:39:32.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary6 2024-09-14T22:39:32.162 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:32.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:32.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:32.167 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:32.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:32.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142765 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary7 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:39:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary7 2024-09-14T22:39:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142897 2024-09-14T22:39:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143029 2024-09-14T22:39:33.100 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3276 2024-09-14T22:39:33.111 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3277 2024-09-14T22:39:33.117 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:33.126 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:33.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:33.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143181 2024-09-14T22:39:33.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:33.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:33.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:33.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:33.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:33.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary8 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:39:34.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary8 2024-09-14T22:39:35.136 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3278 2024-09-14T22:39:35.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:35.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143334 2024-09-14T22:39:35.165 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:36.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:36.120 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143508 2024-09-14T22:39:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary9 2024-09-14T22:39:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:36.128 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:39:36.129 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary9 2024-09-14T22:39:36.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3279 2024-09-14T22:39:36.178 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:37.131 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3280 2024-09-14T22:39:37.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:38.168 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143681 2024-09-14T22:39:39.072 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3281 2024-09-14T22:39:39.099 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for i in {1..30} 2024-09-14T22:39:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ mirror_image_snapshot cluster1 mirror image-primary10 2024-09-14T22:39:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:39:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:39:39.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:39:39.182 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 mirror image snapshot mirror/image-primary10 2024-09-14T22:39:40.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:40.161 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143947 2024-09-14T22:39:40.173 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Snapshot ID: 3282 2024-09-14T22:39:40.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 3 2024-09-14T22:39:42.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${SNAP_PIDS[@]} 2024-09-14T22:39:42.103 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 144081 2024-09-14T22:39:43.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:39:43.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:39:43.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142634 2024-09-14T22:42:05.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:05.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:05.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:05.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142766 2024-09-14T22:42:06.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:06.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:06.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:06.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 142898 2024-09-14T22:42:07.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:07.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:07.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:07.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143030 2024-09-14T22:42:08.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:08.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:08.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:08.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143182 2024-09-14T22:42:10.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:10.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:10.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:10.108 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143335 2024-09-14T22:42:11.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:11.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:11.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:11.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143509 2024-09-14T22:42:13.088 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:13.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:13.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:13.089 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143682 2024-09-14T22:42:15.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:15.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:15.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:15.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 143948 2024-09-14T22:42:17.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:17.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:17.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${WORKLOAD_PIDS[@]} 2024-09-14T22:42:17.299 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 144082 2024-09-14T22:42:19.145 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ret=124 2024-09-14T22:42:19.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( ret != 124 )) 2024-09-14T22:42:19.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:42:19.146 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.148 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 1 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd0 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary1 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary1 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary1 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 2 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd1 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary2 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary2 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary2 2024-09-14T22:42:19.149 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 3 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd2 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary3 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary3 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary3 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.150 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 4 2024-09-14T22:42:19.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd3 2024-09-14T22:42:19.151 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary4 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary4 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary4 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd4 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary5 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 6 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd5 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary6 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary6 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary6 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.153 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.154 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 7 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd6 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary7 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary7 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary7 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 8 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd7 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 9 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary8 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary8 2024-09-14T22:42:19.155 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary8 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ COMPARE_PIDS+=($!) 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149970 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd8 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary9 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary9 2024-09-14T22:42:19.156 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary9 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ compare_demoted_promoted_image 10 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local dev=/dev/rbd9 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local img=image-primary10 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local mntpt=test-primary10 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local demote_md5 promote_md5 2024-09-14T22:42:19.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo umount test-primary10 2024-09-14T22:42:19.670 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:42:19.673 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:19.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:42:19.693 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:19.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:19.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:42:19.906 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:42:19.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:42:19.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:19.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:42:19.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:20.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:42:20.008 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:20.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:20.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:42:20.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:42:20.054 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:42:20.071 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:42:20.073 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:13.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=dc66f1b9e25a7aebd36977887bcb754a 2024-09-14T22:43:13.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary3 2024-09-14T22:43:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary3 2024-09-14T22:43:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:13.819 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary3 2024-09-14T22:43:13.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ed66a09ef7d41fea0f1b74b62163b7bc 2024-09-14T22:43:13.986 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary1 2024-09-14T22:43:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary1 2024-09-14T22:43:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:14.166 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary1 2024-09-14T22:43:14.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=a3a0b3004fb544db6e699467bba09de1 2024-09-14T22:43:14.348 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary9 2024-09-14T22:43:14.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary9 2024-09-14T22:43:14.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:14.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:14.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:14.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary9 2024-09-14T22:43:14.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=0cd4ef897a30c897bd377219c5510dc6 2024-09-14T22:43:14.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary7 2024-09-14T22:43:14.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=ac5ba106d80fa96477b3aa623236b4ac 2024-09-14T22:43:14.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary8 2024-09-14T22:43:15.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary7 2024-09-14T22:43:15.101 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:15.102 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary7 2024-09-14T22:43:15.157 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary8 2024-09-14T22:43:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:15.158 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary8 2024-09-14T22:43:15.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=984fc6b6e2c1eb14be82f0990bb13e22 2024-09-14T22:43:15.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary5 2024-09-14T22:43:15.176 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+unknown 2024-09-14T22:43:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.205 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:15.206 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:15.207 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:15.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:15.210 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+unknown 2024-09-14T22:43:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:15.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:15.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+unknown 2024-09-14T22:43:15.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:15.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:15.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:15.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:15.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:15.244 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary5 2024-09-14T22:43:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary5 2024-09-14T22:43:15.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=82109bf930ebb18610d0c372e60465f1 2024-09-14T22:43:15.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary6 2024-09-14T22:43:15.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary6 2024-09-14T22:43:15.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:15.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:15.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:15.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary6 2024-09-14T22:43:15.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=de9b9758b846b22e1c1c1d647c79dbca 2024-09-14T22:43:15.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary2 2024-09-14T22:43:16.181 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:16.183 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+unknown 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:16.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:16.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:16.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:16.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+unknown 2024-09-14T22:43:16.194 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:16.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary2 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.211 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:16.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary2 2024-09-14T22:43:16.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:16.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:43:16.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:16.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:16.243 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:16.247 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:16.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:16.248 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:43:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=c54a7093f400b7d49dd8dd30e79dc4d8 2024-09-14T22:43:16.259 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary10 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:16.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:16.328 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:16.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:16.350 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:16.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:16.352 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:16.353 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:16.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:16.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:16.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary10 2024-09-14T22:43:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:16.420 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary10 2024-09-14T22:43:17.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:17.196 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:43:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:17.197 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:17.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:43:17.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+unknown 2024-09-14T22:43:17.212 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:17.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_md5=4fcc7034ff2b0095e75e4925c5bf8795 2024-09-14T22:43:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster1 device unmap -t krbd mirror/image-primary4 2024-09-14T22:43:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:43:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:43:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:17.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:17.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:17.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:17.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:17.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:17.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:17.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:17.304 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ demote_image cluster1 mirror image-primary4 2024-09-14T22:43:17.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:17.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:17.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:17.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster1 mirror image demote mirror/image-primary4 2024-09-14T22:43:18.198 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:18.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:18.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:43:18.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.213 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:18.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:43:18.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+unknown 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.221 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:18.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+unknown 2024-09-14T22:43:18.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+unknown 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.233 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.234 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:18.301 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:18.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:18.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:18.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:18.332 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.355 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:18.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:18.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:18.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:18.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:18.359 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:43:18.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:18.407 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:18.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:18.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.410 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:18.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:18.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:18.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:18.432 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:18.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:18.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:18.436 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:18.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:18.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:18.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:18.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:18.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:18.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:18.440 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:19.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image demoted to non-primary 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+unknown 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:19.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:43:19.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:19.228 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:19.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:19.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.293 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:19.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:19.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:19.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:19.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:19.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:19.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:19.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:19.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:19.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:19.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:19.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:43:19.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:43:19.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:19.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:19.312 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:19.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:19.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:19.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:19.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:19.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:19.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:19.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:43:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:43:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:19.372 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:19.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:19.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:19.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.375 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:19.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:43:19.382 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:43:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:19.383 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:19.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:19.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:19.385 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:20.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:20.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:20.282 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:20.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:20.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:20.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 2 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:20.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:20.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:20.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:21.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:21.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:21.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:21.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:21.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:21.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:21.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:21.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:21.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:21.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:21.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:21.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:21.406 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:21.408 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:21.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:43:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:22.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:22.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:22.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:43:22.373 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:22.374 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:22.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:22.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:22.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 4 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:22.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:22.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:22.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:43:22.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:22.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:22.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:22.437 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:22.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:43:22.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:22.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:22.441 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:22.442 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:43:22.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:22.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:22.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:22.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:22.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:22.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:22.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:22.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:22.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:22.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:22.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:22.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:22.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:22.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:22.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:22.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:22.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:22.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:22.524 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:22.528 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:22.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:22.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:22.530 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:23.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:23.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:43:23.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:23.388 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:43:23.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:43:23.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:43:23.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:23.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:23.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:23.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:23.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:23.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:23.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:23.476 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:23.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:23.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:23.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:23.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:24.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:24.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:43:24.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:24.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:24.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:24.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:25.411 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:25.412 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:43:25.413 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:25.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:43:25.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:25.414 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:25.500 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:25.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:25.502 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:25.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:25.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:25.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:25.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:25.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:25.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:25.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:25.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:25.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:26.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:43:26.379 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:26.380 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:26.467 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:26.468 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:26.470 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:30.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:30.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:30.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:30.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:30.504 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:30.526 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:30.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:30.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:30.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:30.527 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:43:30.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:30.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:30.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:30.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:30.534 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:43:30.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:30.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:30.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:30.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:30.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:30.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:30.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:30.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:30.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:30.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:30.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:30.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:30.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:30.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:30.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+stopped 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: local image is primary 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:01' 2024-09-14T22:43:30.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:30.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 1 2024-09-14T22:43:30.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:30.620 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 8 2024-09-14T22:43:31.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+unknown '' '' 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:31.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+unknown '' '' 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:31.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:31.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:31.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:31.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:31.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:31.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:31.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:31.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:31.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:31.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:31.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:31.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:31.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:31.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:31.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:31.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:31.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:31.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:31.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:31.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:31.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:31.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:31.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:31.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:31.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:31.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:31.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:31.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:31.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:43:31.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:31.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:31.733 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:43:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:31.750 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:31.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:43:31.751 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:43:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:31.755 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:31.756 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:31.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:31.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary8 up+unknown 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:31.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary7 up+unknown 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:31.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:31.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+unknown '' '' 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.485 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:32.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:32.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.486 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:32.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:32.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:32.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:32.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:32.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:32.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:32.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:32.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:32.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:32.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:32.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:32.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:43:32.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:43:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:32.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:32.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:32.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:32.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:32.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:32.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary5 up+unknown 2024-09-14T22:43:32.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:32.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary8 up+unknown '' '' 2024-09-14T22:43:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:32.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary7 up+unknown '' '' 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:32.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary8 2024-09-14T22:43:32.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary7 2024-09-14T22:43:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:43:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:43:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:32.835 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:43:32.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:32.837 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:32.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:32.838 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:32.839 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:32.840 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:32.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:32.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:32.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:32.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:32.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:32.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:32.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:32.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:32.847 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:32.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:32.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:32.848 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary7 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:32.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary8 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:32.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:32.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:32.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:32.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:32.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:43:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:32.990 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:43:32.991 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:43:32.994 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:32.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:43:32.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:32.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:32.996 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:32.999 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary7 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:43:33.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:33.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary7 2024-09-14T22:43:33.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.002 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary8 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:33.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary8 2024-09-14T22:43:33.236 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:33.238 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:33.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:33.250 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:33.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary8 2024-09-14T22:43:33.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:33.251 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:33.252 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary7 2024-09-14T22:43:33.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd0 2024-09-14T22:43:33.390 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd1 2024-09-14T22:43:33.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd0 2024-09-14T22:43:33.391 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:33.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd1 2024-09-14T22:43:33.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:33.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+unknown '' '' 2024-09-14T22:43:33.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+unknown '' '' 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+unknown '' '' 2024-09-14T22:43:33.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:43:33.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:43:33.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:33.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:33.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:33.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:33.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:33.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:33.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:33.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:33.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:33.642 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.643 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:33.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:33.644 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:33.645 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:33.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:33.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:33.649 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:33.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:33.656 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.657 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:33.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:33.663 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:33.664 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.665 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:33.666 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:33.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary5 up+unknown '' '' 2024-09-14T22:43:33.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary5 2024-09-14T22:43:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:43:33.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:43:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:33.843 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:33.845 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:33.846 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:33.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:33.850 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:33.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:33.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:33.852 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:33.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:43:33.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:33.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.858 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:33.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:43:33.859 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:33.860 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:33.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:33.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:33.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.866 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary5 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:33.867 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:33.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:33.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:33.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary6 up+unknown 2024-09-14T22:43:33.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:33.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:33.874 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:43:33.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:43:33.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:33.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:33.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:33.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:43:33.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.882 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:33.885 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.886 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:33.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary2 up+unknown 2024-09-14T22:43:33.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:33.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:33.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:43:33.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:33.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:33.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:33.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:33.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary10 up+unknown 2024-09-14T22:43:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:33.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:33.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:33.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:33.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:33.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:34.000 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:43:34.005 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:34.006 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:43:34.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:34.010 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:34.011 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:34.013 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:34.014 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:34.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:34.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary5 2024-09-14T22:43:34.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:34.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.015 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:43:34.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:34.016 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary5 2024-09-14T22:43:34.242 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:34.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:34.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:34.257 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary5 2024-09-14T22:43:34.387 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd2 2024-09-14T22:43:34.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd2 2024-09-14T22:43:34.389 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+unknown '' '' 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:34.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:34.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:43:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:43:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:43:34.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:34.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:34.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:34.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:34.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:34.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:34.571 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:34.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:34.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:34.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:34.583 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:34.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:34.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:34.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:43:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:43:34.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:34.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:34.721 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:34.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:34.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary4 up+unknown 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:34.725 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:34.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary6 up+unknown '' '' 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:34.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary6 2024-09-14T22:43:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary2 up+unknown '' '' 2024-09-14T22:43:34.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:34.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:34.891 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary2 2024-09-14T22:43:34.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary10 up+unknown '' '' 2024-09-14T22:43:34.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:34.897 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:34.898 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary10 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:34.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:34.977 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:34.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:34.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:34.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:34.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:34.984 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:34.987 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:34.992 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:34.993 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:34.995 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary6 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:35.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:35.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:35.004 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:35.020 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:35.024 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:35.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:35.027 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:35.029 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:35.030 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:35.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:35.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:35.033 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:35.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:35.036 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:35.037 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:35.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.039 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:35.040 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:35.041 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:35.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.042 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary2 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.046 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:35.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:35.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:35.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:35.047 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:35.048 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:35.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary10 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:35.051 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:35.052 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:35.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:35.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:35.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:43:35.200 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.201 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:43:35.216 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:35.220 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:35.223 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.225 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.226 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary6 2024-09-14T22:43:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:43:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:35.227 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary6 2024-09-14T22:43:35.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:35.308 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:43:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:35.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:43:35.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.313 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:43:35.314 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:43:35.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.320 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:35.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary2 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary2 2024-09-14T22:43:35.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary10 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:43:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:35.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary10 2024-09-14T22:43:35.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary4 up+unknown '' '' 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:35.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary4 2024-09-14T22:43:35.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:43:35.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:43:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:35.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:35.811 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:35.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:35.814 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:35.815 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.816 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.818 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:35.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:35.821 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:35.823 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:35.828 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary4 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:35.829 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:35.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:35.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:35.968 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:43:35.973 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:35.974 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:43:35.978 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:35.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:35.979 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:35.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary4 2024-09-14T22:43:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:43:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary4 2024-09-14T22:43:36.288 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:36.289 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:36.294 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:36.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:36.315 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:36.317 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary4 2024-09-14T22:43:36.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:36.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:36.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary2 2024-09-14T22:43:36.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:36.321 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:36.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary6 2024-09-14T22:43:36.323 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:36.324 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:36.325 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary10 2024-09-14T22:43:36.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd5 2024-09-14T22:43:36.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd3 2024-09-14T22:43:36.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd5 2024-09-14T22:43:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd3 2024-09-14T22:43:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:36.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd4 2024-09-14T22:43:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd4 2024-09-14T22:43:36.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:36.586 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd6 2024-09-14T22:43:36.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd6 2024-09-14T22:43:36.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:38.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:38.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:38.602 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:43:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.627 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:43:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:43:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:38.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:38.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:38.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:38.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:38.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:38.778 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:38.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:38.783 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:38.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:38.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:38.798 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:38.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.809 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:38.824 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:38.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:38.836 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:38.841 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:38.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:38.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:38.844 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:38.851 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:38.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:38.853 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:38.854 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:38.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:38.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:38.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:38.865 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:38.870 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:38.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:38.875 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:38.879 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:38.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:38.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:38.889 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:38.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:38.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.894 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:38.900 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:38.905 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:38.909 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:38.922 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:38.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:38.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:39.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:39.092 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:39.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:43:39.110 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:39.113 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:43:39.142 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:39.160 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary3 up+unknown 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:39.163 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:39.164 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:39.184 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:39.185 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:39.186 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:43:39.193 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:39.195 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:43:39.202 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:39.209 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:39.214 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:39.237 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary9 up+unknown 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:39.239 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:39.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:39.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:39.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:39.240 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:39.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41964257mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:39.254 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:39.255 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:43:39.263 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:39.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:43:39.302 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:39.303 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:39.305 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:39.309 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:39.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.310 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster2 mirror image-primary1 up+unknown 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:43:39.311 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary3 up+unknown '' '' 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:40.170 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:40.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.171 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary3 2024-09-14T22:43:40.256 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary9 up+unknown '' '' 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:40.260 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.264 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary9 2024-09-14T22:43:40.316 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster2 mirror image-primary1 up+unknown '' '' 2024-09-14T22:43:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.318 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:43:40.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:43:40.319 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.330 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror image status mirror/image-primary1 2024-09-14T22:43:40.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:43:40.450 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:43:40.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:40.451 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:40.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:40.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:40.452 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:40.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:40.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:40.474 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:40.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:40.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:40.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:40.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:40.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:40.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:40.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:40.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:40.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:40.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary3 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:40.505 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:40.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:40.506 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.507 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:40.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:43:40.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:43:40.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:40.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:40.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:40.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:40.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:40.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:40.533 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:40.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:40.546 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:40.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:40.553 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:40.556 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:40.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:40.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:40.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:40.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary9 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:40.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.596 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+unknown 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: remote image is not primary 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:43:31' 2024-09-14T22:43:40.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+unknown' 2024-09-14T22:43:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+unknown 2024-09-14T22:43:40.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:43:40.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: remote image is not primary 2024-09-14T22:43:40.626 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:43:40.629 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:40.630 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:43:40.634 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:40.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:43:40.646 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:43:40.648 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:43:40.650 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:43:40.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:40.660 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster2 mirror image-primary1 up+unknown '2024-09-14 22:43:31' 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+unknown 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:43:31' 2024-09-14T22:43:40.661 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:43:40.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:43:40.662 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster2 mirror pool status mirror --verbose --format xml 2024-09-14T22:43:40.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:40.869 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:40.871 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:43:40.890 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:40.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:43:40.916 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:40.930 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary3 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:40.934 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary3 2024-09-14T22:43:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:40.981 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:40.982 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:43:41.003 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:41.007 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:43:41.023 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:41.025 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:41.028 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:41.032 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary1 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:41.035 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary1 2024-09-14T22:43:41.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041934232mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary858f59259-627b-4b00-baee-b994170b442bup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+unknownremote image is not primary41934232mirror.0smithi1692024-09-14 22:43:31' 2024-09-14T22:43:41.053 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:43:41.055 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:43:41.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:43:31' 2024-09-14T22:43:41.069 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:43:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+unknown 2024-09-14T22:43:41.086 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+unknown 2024-09-14T22:43:41.087 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+unknown 2024-09-14T22:43:41.094 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+unknown 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_image cluster2 mirror image-primary9 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:43:41.095 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local force= 2024-09-14T22:43:41.096 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 mirror image promote mirror/image-primary9 2024-09-14T22:43:41.331 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:41.358 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:41.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:41.369 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:41.371 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary1 2024-09-14T22:43:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:41.404 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:41.405 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary3 2024-09-14T22:43:41.753 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd7 2024-09-14T22:43:41.754 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd8 2024-09-14T22:43:41.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:41.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd7 2024-09-14T22:43:41.759 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:43:41.761 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd8 2024-09-14T22:43:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:Image promoted to primary 2024-09-14T22:43:42.392 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \n\b\d ]] 2024-09-14T22:43:42.393 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ krbd == \k\r\b\d ]] 2024-09-14T22:43:42.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo rbd --cluster cluster2 device map -t krbd mirror/image-primary9 2024-09-14T22:43:42.857 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ dev=/dev/rbd9 2024-09-14T22:43:42.863 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sudo md5sum /dev/rbd9 2024-09-14T22:43:42.864 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ awk '{print $1}' 2024-09-14T22:44:24.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ac5ba106d80fa96477b3aa623236b4ac 2024-09-14T22:44:24.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd1 2024-09-14T22:44:24.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ac5ba106d80fa96477b3aa623236b4ac != \a\c\5\b\a\1\0\6\d\8\0\f\a\9\6\4\7\7\b\3\a\a\6\2\3\2\3\6\b\4\a\c ]] 2024-09-14T22:44:25.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=0cd4ef897a30c897bd377219c5510dc6 2024-09-14T22:44:25.950 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd0 2024-09-14T22:44:26.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 0cd4ef897a30c897bd377219c5510dc6 != \0\c\d\4\e\f\8\9\7\a\3\0\c\8\9\7\b\d\3\7\7\2\1\9\c\5\5\1\0\d\c\6 ]] 2024-09-14T22:44:27.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=de9b9758b846b22e1c1c1d647c79dbca 2024-09-14T22:44:27.068 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd5 2024-09-14T22:44:27.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=984fc6b6e2c1eb14be82f0990bb13e22 2024-09-14T22:44:27.179 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd2 2024-09-14T22:44:27.273 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ de9b9758b846b22e1c1c1d647c79dbca != \d\e\9\b\9\7\5\8\b\8\4\6\b\2\2\e\1\c\1\c\1\d\6\4\7\c\7\9\d\b\c\a ]] 2024-09-14T22:44:27.365 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 984fc6b6e2c1eb14be82f0990bb13e22 != \9\8\4\f\c\6\b\6\e\2\c\1\e\b\1\4\b\e\8\2\f\0\9\9\0\b\b\1\3\e\2\2 ]] 2024-09-14T22:44:28.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=4fcc7034ff2b0095e75e4925c5bf8795 2024-09-14T22:44:28.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd3 2024-09-14T22:44:28.329 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 4fcc7034ff2b0095e75e4925c5bf8795 != \4\f\c\c\7\0\3\4\f\f\2\b\0\0\9\5\e\7\5\e\4\9\2\5\c\5\b\f\8\7\9\5 ]] 2024-09-14T22:44:28.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=82109bf930ebb18610d0c372e60465f1 2024-09-14T22:44:28.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd4 2024-09-14T22:44:28.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ 82109bf930ebb18610d0c372e60465f1 != \8\2\1\0\9\b\f\9\3\0\e\b\b\1\8\6\1\0\d\0\c\3\7\2\e\6\0\4\6\5\f\1 ]] 2024-09-14T22:44:30.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=c54a7093f400b7d49dd8dd30e79dc4d8 2024-09-14T22:44:30.842 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd6 2024-09-14T22:44:30.941 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ c54a7093f400b7d49dd8dd30e79dc4d8 != \c\5\4\a\7\0\9\3\f\4\0\0\b\7\d\4\9\d\d\8\d\d\3\0\e\7\9\d\c\4\d\8 ]] 2024-09-14T22:44:32.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=dc66f1b9e25a7aebd36977887bcb754a 2024-09-14T22:44:32.637 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd8 2024-09-14T22:44:32.904 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ dc66f1b9e25a7aebd36977887bcb754a != \d\c\6\6\f\1\b\9\e\2\5\a\7\a\e\b\d\3\6\9\7\7\8\8\7\b\c\b\7\5\4\a ]] 2024-09-14T22:44:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=ed66a09ef7d41fea0f1b74b62163b7bc 2024-09-14T22:44:33.489 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd7 2024-09-14T22:44:33.589 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ ed66a09ef7d41fea0f1b74b62163b7bc != \e\d\6\6\a\0\9\e\f\7\d\4\1\f\e\a\0\f\1\b\7\4\b\6\2\1\6\3\b\7\b\c ]] 2024-09-14T22:44:33.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.590 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149971 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149973 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149975 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149977 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149978 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149981 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149983 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:33.591 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149984 2024-09-14T22:44:34.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ promote_md5=a3a0b3004fb544db6e699467bba09de1 2024-09-14T22:44:34.090 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sudo rbd --cluster cluster2 device unmap -t krbd /dev/rbd9 2024-09-14T22:44:34.187 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ [[ a3a0b3004fb544db6e699467bba09de1 != \a\3\a\0\b\3\0\0\4\f\b\5\4\4\d\b\6\e\6\9\9\4\6\7\b\b\a\0\9\d\e\1 ]] 2024-09-14T22:44:34.188 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for pid in ${COMPARE_PIDS[@]} 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait 149986 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ (( RET != 0 )) 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary1 up+replaying 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:34.189 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:34.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:35.190 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary1 up+replaying '' '' 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:35.191 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:35.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:35.192 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary1 2024-09-14T22:44:35.277 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary1: 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 1a653457-9f51-4660-b86b-39185ab2fd42 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3645235.2,"bytes_per_snapshot":72904704.0,"last_snapshot_bytes":72904704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"} 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:35.278 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:35.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:35.281 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:35.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3645235.2,"bytes_per_snapshot":72904704.0,"last_snapshot_bytes":72904704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"} 2024-09-14T22:44:35.284 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:35.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:35.285 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:35.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:35.287 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:35.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:35.290 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:35.291 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:35.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:35.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary1 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:35.295 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:35.296 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:35.297 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:35.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING1041964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary11a653457-9f51-4660-b86b-39185ab2fd42up+replayingreplaying, {"bytes_per_second":3645235.2,"bytes_per_snapshot":72904704.0,"last_snapshot_bytes":72904704,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+replayingreplaying, {"bytes_per_second":3218227.2,"bytes_per_snapshot":64364544.0,"last_snapshot_bytes":64364544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+replayingreplaying, {"bytes_per_second":3583590.4,"bytes_per_snapshot":71671808.0,"last_snapshot_bytes":71671808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+replayingreplaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+replayingreplaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:35.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:35.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/last_update' 2024-09-14T22:44:35.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:35.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary1'\'']/state' 2024-09-14T22:44:35.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:35.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:35.427 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:35.429 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary1 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:35.430 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:35.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary1 2024-09-14T22:44:35.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary1 2024-09-14T22:44:35.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:35.643+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b591c7bd40 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:35.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:35.643+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaa00 [3/1a653457-9f51-4660-b86b-39185ab2fd42] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:37.542 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary1 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary1 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary1 2024-09-14T22:44:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary1 2024-09-14T22:44:37.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:37.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary2 2024-09-14T22:44:37.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary2 2024-09-14T22:44:37.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:37.697 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary2 up+replaying 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:37.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary2 up+replaying '' '' 2024-09-14T22:44:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:38.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:38.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary2 2024-09-14T22:44:38.790 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary2: 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 54364ab6-16df-4a80-b8ce-01587a11ccc9 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3218227.2,"bytes_per_snapshot":64364544.0,"last_snapshot_bytes":64364544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:38.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:38.793 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:38.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3218227.2,"bytes_per_snapshot":64364544.0,"last_snapshot_bytes":64364544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:38.796 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:38.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:38.797 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:38.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:38.799 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:38.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:38.802 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:38.803 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary2 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:38.807 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:38.808 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:38.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING941964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary254364ab6-16df-4a80-b8ce-01587a11ccc9up+replayingreplaying, {"bytes_per_second":3218227.2,"bytes_per_snapshot":64364544.0,"last_snapshot_bytes":64364544,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+replayingreplaying, {"bytes_per_second":3583590.4,"bytes_per_snapshot":71671808.0,"last_snapshot_bytes":71671808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+replayingreplaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+replayingreplaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:38.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:38.919 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/last_update' 2024-09-14T22:44:38.923 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:38.924 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary2'\'']/state' 2024-09-14T22:44:38.928 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:38.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:38.929 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:38.931 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary2 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:38.932 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary2 2024-09-14T22:44:38.997 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary2 2024-09-14T22:44:39.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:39.142+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a690000 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:39.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:39.142+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5680 [3/54364ab6-16df-4a80-b8ce-01587a11ccc9] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:40.554 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:40.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary2 2024-09-14T22:44:40.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:40.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:40.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary2 2024-09-14T22:44:40.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:40.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:40.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary2 2024-09-14T22:44:40.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:40.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary2 2024-09-14T22:44:40.618 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary3 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary3 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary3 up+replaying 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:40.619 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary3 up+replaying '' '' 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:41.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:41.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:41.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:41.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary3 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary3: 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3583590.4,"bytes_per_snapshot":71671808.0,"last_snapshot_bytes":71671808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"} 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:41.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:41.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:41.709 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:41.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3583590.4,"bytes_per_snapshot":71671808.0,"last_snapshot_bytes":71671808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"} 2024-09-14T22:44:41.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:41.712 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:41.713 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:41.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:41.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:41.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:41.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:41.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary3 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:41.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:41.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:41.724 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING841964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary3a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303up+replayingreplaying, {"bytes_per_second":3583590.4,"bytes_per_snapshot":71671808.0,"last_snapshot_bytes":71671808,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353821,"remote_snapshot_timestamp":1726353821,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+replayingreplaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+replayingreplaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:41.868 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/last_update' 2024-09-14T22:44:41.872 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:41.873 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary3'\'']/state' 2024-09-14T22:44:41.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:41.877 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:41.878 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:41.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:41.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:41.880 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:41.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary3 2024-09-14T22:44:41.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:41.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:41.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:41.881 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary3 2024-09-14T22:44:41.947 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary3 2024-09-14T22:44:42.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:42.181+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5896a76c0 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:42.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:42.181+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dca280 [3/a43e5e43-bd58-4ee5-a0ad-6ffe8a7a0303] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:43.409 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:43.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary3 2024-09-14T22:44:43.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:43.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:43.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary3 2024-09-14T22:44:43.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:43.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:43.416 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary3 2024-09-14T22:44:43.478 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:43.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary3 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary4 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary4 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary4 up+replaying 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:43.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:43.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:43.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:43.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:43.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:43.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:44.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary4 up+replaying '' '' 2024-09-14T22:44:44.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:44.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:44.484 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary4 2024-09-14T22:44:44.560 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary4: 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 4f7d5dfb-9437-43fc-bd15-ec569e28dd54 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:44.561 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:44.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:44.563 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:44.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:44.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:44.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:44.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:44.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:44.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:44.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:44.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:44.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary4 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:44.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:44.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:44.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:44.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING741964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary44f7d5dfb-9437-43fc-bd15-ec569e28dd54up+replayingreplaying, {"bytes_per_second":3306086.4,"bytes_per_snapshot":66121728.0,"last_snapshot_bytes":66121728,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+replayingreplaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:44.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:44.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/last_update' 2024-09-14T22:44:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:44.700 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary4'\'']/state' 2024-09-14T22:44:44.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:44.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:44.705 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:44.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:44.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:44.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:44.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary4 2024-09-14T22:44:44.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:44.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:44.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:44.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary4 2024-09-14T22:44:44.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary4 2024-09-14T22:44:44.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:44.920+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58a767860 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:44.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:44.920+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcb400 [3/4f7d5dfb-9437-43fc-bd15-ec569e28dd54] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:46.572 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:46.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary4 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary4 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:46.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary4 2024-09-14T22:44:46.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:46.635 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary4 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary5 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary5 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:46.638 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary5 up+replaying 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:46.639 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:47.640 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary5 up+replaying '' '' 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:47.641 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary5 2024-09-14T22:44:47.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary5: 2024-09-14T22:44:47.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1 2024-09-14T22:44:47.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:47.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"} 2024-09-14T22:44:47.757 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:47.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:47.758 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:47.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:47.760 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:47.762 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"} 2024-09-14T22:44:47.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:47.763 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:47.764 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:47.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:47.766 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:47.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:47.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:47.769 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:47.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary5 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:47.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING641964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary5f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1up+replayingreplaying, {"bytes_per_second":3591577.6,"bytes_per_snapshot":71831552.0,"last_snapshot_bytes":71831552,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353814,"remote_snapshot_timestamp":1726353814,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:47.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:47.884 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/last_update' 2024-09-14T22:44:47.887 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:47.888 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary5'\'']/state' 2024-09-14T22:44:47.892 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:47.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:47.893 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:47.895 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary5 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:47.896 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary5 2024-09-14T22:44:47.962 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary5 2024-09-14T22:44:48.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:48.152+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d36820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:48.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:48.152+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e4000 [3/f647d9b5-8e9c-4e7d-a39d-ae7f576e39a1] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:49.415 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:49.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary5 2024-09-14T22:44:49.421 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:49.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:49.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary5 2024-09-14T22:44:49.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:49.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:49.422 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary5 2024-09-14T22:44:49.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:49.477 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary5 2024-09-14T22:44:49.479 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary6 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary6 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary6 up+replaying 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:49.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:49.481 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary6 up+replaying '' '' 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:50.482 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:50.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:50.483 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary6 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary6: 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 5d694260-a7dc-45e0-a448-d6356e6030c1 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:50.595 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:50.597 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:50.598 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:50.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:44:50.600 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:50.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:50.601 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:50.603 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:50.604 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:50.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:50.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:50.608 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary6 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:50.612 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:50.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:50.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:50.767 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING541964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary65d694260-a7dc-45e0-a448-d6356e6030c1up+replayingreplaying, {"bytes_per_second":3604480.0,"bytes_per_snapshot":72089600.0,"last_snapshot_bytes":72089600,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:50.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:50.768 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/last_update' 2024-09-14T22:44:50.772 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:50.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary6'\'']/state' 2024-09-14T22:44:50.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:50.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:50.777 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:50.779 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:50.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:50.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:50.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary6 2024-09-14T22:44:50.780 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:50.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:50.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:50.781 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary6 2024-09-14T22:44:50.849 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary6 2024-09-14T22:44:51.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:51.077+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589ed4d00 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:51.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:51.077+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5900 [3/5d694260-a7dc-45e0-a448-d6356e6030c1] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:52.431 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary6 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary6 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:52.438 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:52.439 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary6 2024-09-14T22:44:52.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:52.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary6 2024-09-14T22:44:52.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:52.495 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary7 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary7 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary7 up+replaying 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:52.496 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:52.497 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary7 up+replaying '' '' 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:53.498 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:53.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:53.499 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary7 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary7: 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"} 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:53.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:53.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"} 2024-09-14T22:44:53.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:53.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:53.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:53.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:53.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:53.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:53.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:53.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary7 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:53.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:53.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:53.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:53.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING441964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary7bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270up+replayingreplaying, {"bytes_per_second":3655065.6,"bytes_per_snapshot":73101312.0,"last_snapshot_bytes":73101312,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:53.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:53.692 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/last_update' 2024-09-14T22:44:53.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:53.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary7'\'']/state' 2024-09-14T22:44:53.703 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:53.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:53.704 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:53.706 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:53.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:53.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:53.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary7 2024-09-14T22:44:53.707 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:53.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:53.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:53.708 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary7 2024-09-14T22:44:53.773 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary7 2024-09-14T22:44:53.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:53.928+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b588d36680 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:53.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:53.928+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b588dcaf00 [3/bc8d97b1-04e6-4cba-b49d-fd7e7bbe1270] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:55.426 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary7 2024-09-14T22:44:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary7 2024-09-14T22:44:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:55.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:55.434 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary7 2024-09-14T22:44:55.487 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:55.488 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary7 2024-09-14T22:44:55.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:55.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary8 2024-09-14T22:44:55.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary8 2024-09-14T22:44:55.490 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary8 up+replaying 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:55.491 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary8 up+replaying '' '' 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:56.493 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:56.494 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary8 2024-09-14T22:44:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary8: 2024-09-14T22:44:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 58f59259-627b-4b00-baee-b994170b442b 2024-09-14T22:44:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:56.575 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"} 2024-09-14T22:44:56.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:56.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:56.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:56.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:56.578 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:56.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"} 2024-09-14T22:44:56.581 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:56.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:56.582 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:56.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:56.587 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:56.588 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary8 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:56.592 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:56.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:56.593 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:56.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING341964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary858f59259-627b-4b00-baee-b994170b442bup+replayingreplaying, {"bytes_per_second":3643187.2,"bytes_per_snapshot":72863744.0,"last_snapshot_bytes":72863744,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353813,"remote_snapshot_timestamp":1726353813,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:56.686 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:56.687 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/last_update' 2024-09-14T22:44:56.690 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:56.691 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary8'\'']/state' 2024-09-14T22:44:56.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:56.695 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:56.696 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:56.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:56.698 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary8 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:56.699 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary8 2024-09-14T22:44:56.765 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary8 2024-09-14T22:44:56.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:56.916+0000 7f81b5800640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b5890f6000 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:44:56.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:44:56.916+0000 7f81bda00640 -1 rbd::mirror::ImageReplayer: 0x55b588dcac80 [3/58f59259-627b-4b00-baee-b994170b442b] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:44:58.396 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary8 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary8 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:44:58.402 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary8 2024-09-14T22:44:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:58.457 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary8 2024-09-14T22:44:58.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:44:58.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary9 2024-09-14T22:44:58.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary9 2024-09-14T22:44:58.460 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary9 up+replaying 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:44:58.461 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:44:59.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary9 up+replaying '' '' 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:59.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:59.464 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary9 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary9: 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: d17b22ba-bfc6-41aa-a886-65048e2d069e 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"} 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:44:31' 2024-09-14T22:44:59.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:44:59.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:44:59.570 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:44:59.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"} 2024-09-14T22:44:59.573 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:44:59.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:59.574 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:44:59.576 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:59.577 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:44:59.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:44:59.579 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:44:59.580 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:44:59.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:59.584 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary9 up+replaying '2024-09-14 22:44:31' 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:44:31' 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:44:59.585 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:44:59.717 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING241964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":3610624.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31image-primary9d17b22ba-bfc6-41aa-a886-65048e2d069eup+replayingreplaying, {"bytes_per_second":3647488.0,"bytes_per_snapshot":72949760.0,"last_snapshot_bytes":72949760,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353822,"remote_snapshot_timestamp":1726353822,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:44:31' 2024-09-14T22:44:59.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:44:59.718 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/last_update' 2024-09-14T22:44:59.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:44:31' 2024-09-14T22:44:59.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary9'\'']/state' 2024-09-14T22:44:59.727 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:44:59.728 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:44:59.729 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:44:59.731 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary9 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:44:59.732 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary9 2024-09-14T22:44:59.800 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary9 2024-09-14T22:45:00.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:00.022+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b589cc3a00 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:45:00.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:00.022+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5180 [3/d17b22ba-bfc6-41aa-a886-65048e2d069e] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:45:01.455 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary9 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary9 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:45:01.462 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:45:01.463 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary9 2024-09-14T22:45:01.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:45:01.517 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary9 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for j in {1..10} 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ IMG=image-primary10 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_replaying_status_in_pool_dir cluster1 mirror image-primary10 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' snapshot = journal ']' 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_status_in_pool_dir cluster1 mirror image-primary10 up+replaying 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:45:01.520 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:45:01.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:45:01.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:45:01.521 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ sleep 1 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_status_in_pool_dir cluster1 mirror image-primary10 up+replaying '' '' 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local description_pattern= 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local service_pattern= 2024-09-14T22:45:02.522 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:45:02.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:45:02.523 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror image status mirror/image-primary10 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='image-primary10: 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: global_id: 855adda1-270a-4bbe-978e-72915bdcf194 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: state: up+replaying 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: service: mirror.0 on smithi169 2024-09-14T22:45:02.605 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: last_update: 2024-09-14 22:45:01' 2024-09-14T22:45:02.606 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ state: .*up+replaying' 2024-09-14T22:45:02.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: state: up+replaying 2024-09-14T22:45:02.607 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^ description: .*' 2024-09-14T22:45:02.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"} 2024-09-14T22:45:02.610 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -n '' ']' 2024-09-14T22:45:02.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:45:02.611 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep '^up+' 2024-09-14T22:45:02.613 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:45:02.614 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep 'service: *mirror..* on ' 2024-09-14T22:45:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout: service: mirror.0 on smithi169 2024-09-14T22:45:02.616 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update 2024-09-14T22:45:02.617 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:45:01' 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test_mirror_pool_status_verbose cluster1 mirror image-primary10 up+replaying '2024-09-14 22:45:01' 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:02.621 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local state_pattern=up+replaying 2024-09-14T22:45:02.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local 'prev_last_update=2024-09-14 22:45:01' 2024-09-14T22:45:02.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local status 2024-09-14T22:45:02.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ CEPH_ARGS= 2024-09-14T22:45:02.622 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2024-09-14T22:45:02.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ status='WARNINGOKWARNING141964257mirror.0smithi16919.3.0-4928-g711c10c3trueOKimage-primary10855adda1-270a-4bbe-978e-72915bdcf194up+replayingreplaying, {"bytes_per_second":0.0,"bytes_per_snapshot":72212480.0,"last_snapshot_bytes":72212480,"last_snapshot_sync_seconds":0,"local_snapshot_timestamp":1726353816,"remote_snapshot_timestamp":1726353816,"replay_state":"idle"}41964257mirror.0smithi1692024-09-14 22:45:01' 2024-09-14T22:45:02.710 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local last_update state 2024-09-14T22:45:02.711 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/last_update' 2024-09-14T22:45:02.714 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ last_update='2024-09-14 22:45:01' 2024-09-14T22:45:02.715 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''image-primary10'\'']/state' 2024-09-14T22:45:02.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ state=up+replaying 2024-09-14T22:45:02.719 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo up+replaying 2024-09-14T22:45:02.720 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep up+replaying 2024-09-14T22:45:02.722 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:up+replaying 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ remove_image cluster2 mirror image-primary10 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:02.723 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 snap purge mirror/image-primary10 2024-09-14T22:45:02.791 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster=cluster2 rm mirror/image-primary10 2024-09-14T22:45:02.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:02.950+0000 7f81b4e00640 -1 rbd::mirror::image_replayer::BootstrapRequest: 0x55b58b4e6820 handle_prepare_local_image: error preparing local image for replay: (85) Interrupted system call should be restarted 2024-09-14T22:45:02.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:02.950+0000 7f81bd000640 -1 rbd::mirror::ImageReplayer: 0x55b5892e5400 [3/855adda1-270a-4bbe-978e-72915bdcf194] operator(): start failed: (85) Interrupted system call should be restarted 2024-09-14T22:45:04.501 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-14T22:45:04.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ wait_for_image_removal cluster1 mirror image-primary10 2024-09-14T22:45:04.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:04.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local pool=mirror 2024-09-14T22:45:04.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local image=image-primary10 2024-09-14T22:45:04.508 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2024-09-14T22:45:04.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rbd --cluster cluster1 ls mirror 2024-09-14T22:45:04.509 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ grep -wq image-primary10 2024-09-14T22:45:04.564 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 0 2024-09-14T22:45:04.565 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -rf test-primary10 2024-09-14T22:45:04.566 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo OK 2024-09-14T22:45:04.567 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:OK 2024-09-14T22:45:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ cleanup 0 2024-09-14T22:45:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local error_code=0 2024-09-14T22:45:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ set +e 2024-09-14T22:45:04.568 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -ne 0 ']' 2024-09-14T22:45:04.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z '' ']' 2024-09-14T22:45:04.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster instance 2024-09-14T22:45:04.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T22:45:04.569 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster1 osd pool rm mirror mirror --yes-i-really-really-mean-it 2024-09-14T22:45:06.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:06.109+0000 7f6326e00640 -1 rbd::mirror::image_deleter::SnapshotPurgeRequest: 0x55df442e9c20 handle_snap_remove: failed to remove snapshot: (2) No such file or directory 2024-09-14T22:45:06.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:06.111+0000 7f6305200640 -1 rbd::mirror::image_deleter::TrashRemoveRequest: 0x55df4507c0b0 handle_purge_snapshots: failed to purge image snapshots: (2) No such file or directory 2024-09-14T22:45:06.215 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror' does not exist 2024-09-14T22:45:06.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T22:45:06.231 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster2 osd pool rm mirror mirror --yes-i-really-really-mean-it 2024-09-14T22:45:07.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror' does not exist 2024-09-14T22:45:07.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T22:45:07.394 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster1 osd pool rm mirror_parent mirror_parent --yes-i-really-really-mean-it 2024-09-14T22:45:07.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.939+0000 7f81bda00640 -1 rbd::mirror::LeaderWatcher: 0x55b589438f00 handle_notify_heartbeat: error notifying heartbeat: (2) No such file or directory, releasing leader 2024-09-14T22:45:07.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b4e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55b5896e4240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:07.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b4e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55b5889fc6c0 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:07.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b4e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55b5889fc000 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:07.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b5800640 -1 rbd::mirror::PoolWatcher: 0x55b58790cd20 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:07.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b5800640 -1 rbd::mirror::PoolWatcher: 0x55b58790d860 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:07.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.940+0000 7f81b5800640 -1 rbd::mirror::PoolWatcher: 0x55b58790d4a0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:07.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.943+0000 7f81acc00640 -1 rbd::mirror::PoolWatcher: 0x55b58790dc20 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:07.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.943+0000 7f81bda00640 -1 rbd::mirror::LeaderWatcher: 0x55b589438f00 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-14T22:45:07.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi169.stderr:2024-09-14T22:45:07.943+0000 7f81bda00640 -1 rbd::mirror::LeaderWatcher: 0x55b589438f00 handle_release_leader_lock: error releasing lock: (2) No such file or directory 2024-09-14T22:45:08.307 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror_parent' does not exist 2024-09-14T22:45:08.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ CEPH_ARGS= 2024-09-14T22:45:08.322 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ ceph --cluster cluster2 osd pool rm mirror_parent mirror_parent --yes-i-really-really-mean-it 2024-09-14T22:45:08.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f632e600640 -1 rbd::mirror::LeaderWatcher: 0x55df447daf00 handle_notify_heartbeat: error notifying heartbeat: (2) No such file or directory, releasing leader 2024-09-14T22:45:08.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55df44a82900 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55df44078240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326e00640 -1 rbd::mirror::image_deleter::TrashWatcher: 0x55df44a82240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326400640 -1 rbd::mirror::PoolWatcher: 0x55df43fda000 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326400640 -1 rbd::mirror::PoolWatcher: 0x55df43fda3c0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f6326400640 -1 rbd::mirror::PoolWatcher: 0x55df43fda1e0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f631e200640 -1 rbd::mirror::PoolWatcher: 0x55df43fda5a0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f631e200640 -1 rbd::mirror::PoolWatcher: 0x55df43fda780 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.783+0000 7f631e200640 -1 rbd::mirror::PoolWatcher: 0x55df43fda960 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-14T22:45:08.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.784+0000 7f632e600640 -1 rbd::mirror::LeaderWatcher: 0x55df447daf00 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-14T22:45:08.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi169.stderr:2024-09-14T22:45:08.784+0000 7f632e600640 -1 rbd::mirror::LeaderWatcher: 0x55df447daf00 handle_release_leader_lock: error releasing lock: (2) No such file or directory 2024-09-14T22:45:09.342 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:pool 'mirror_parent' does not exist 2024-09-14T22:45:09.356 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for cluster in "${CLUSTER1}" "${CLUSTER2}" 2024-09-14T22:45:09.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ stop_mirrors cluster1 2024-09-14T22:45:09.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1 2024-09-14T22:45:09.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local sig= 2024-09-14T22:45:09.357 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ seq 0 0 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ stop_mirror cluster1:0 '' 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster1:0 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local sig= 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test -n 1 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for cluster in "${CLUSTER1}" "${CLUSTER2}" 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ stop_mirrors cluster2 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2 2024-09-14T22:45:09.363 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local sig= 2024-09-14T22:45:09.364 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:++ seq 0 0 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ stop_mirror cluster2:0 '' 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local cluster=cluster2:0 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ local sig= 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test -n 1 2024-09-14T22:45:09.366 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ return 2024-09-14T22:45:09.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' -z 1 ']' 2024-09-14T22:45:09.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ test '' = /tmp/tmp.jVjUGLUi4Z 2024-09-14T22:45:09.367 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ rm -Rf /tmp/tmp.jVjUGLUi4Z 2024-09-14T22:45:09.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ '[' 0 -eq 0 ']' 2024-09-14T22:45:09.376 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ echo OK 2024-09-14T22:45:09.377 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stdout:OK 2024-09-14T22:45:09.378 INFO:tasks.workunit.cluster1.client.mirror.smithi169.stderr:+ exit 0 2024-09-14T22:45:09.378 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T22:45:09.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp 2024-09-14T22:45:09.650 INFO:tasks.workunit:Stopping ['rbd/compare_mirror_images.sh'] on cluster1.client.mirror... 2024-09-14T22:45:09.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.cluster1.client.mirror /home/ubuntu/cephtest/clone.cluster1.client.mirror 2024-09-14T22:45:10.548 DEBUG:teuthology.parallel:result is None 2024-09-14T22:45:10.548 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-14T22:45:10.605 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-14T22:45:10.605 DEBUG:teuthology.orchestra.run.smithi169:> rmdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-14T22:45:10.641 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-14T22:45:10.641 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-14T22:45:10.650 DEBUG:tasks.rbd_mirror.cluster2.client.mirror.0:waiting for process to exit 2024-09-14T22:45:10.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:10.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Stopped 2024-09-14T22:45:10.707 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-14T22:45:10.717 DEBUG:tasks.rbd_mirror.cluster1.client.mirror.0:waiting for process to exit 2024-09-14T22:45:10.717 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:10.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Stopped 2024-09-14T22:45:10.770 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T22:45:10.778 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2024-09-14T22:45:10.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T22:45:11.187 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:11.187 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T22:45:11.204 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":4351,"stamp":"2024-09-14T22:45:09.700593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2368212,"kb_used_data":18648,"kb_used_omap":4,"kb_used_meta":2349499,"kb_avail":280747308,"statfs":{"total":289910292480,"available":287485243392,"internally_reserved":0,"allocated":19095552,"data_stored":11142804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":2405887311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299393752,"num_objects":-115,"num_object_clones":0,"num_object_copies":-230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-115,"num_whiteouts":0,"num_read":-516897,"num_read_kb":-36076973,"num_write":-132297,"num_write_kb":-29371026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-8437760,"num_keys_recovered":-1,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615230+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T22:45:07.615230+0000","last_peered":"2024-09-14T22:45:07.615230+0000","last_clean":"2024-09-14T22:45:07.615230+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T22:45:07.615230+0000","last_undegraded":"2024-09-14T22:45:07.615230+0000","last_fullsized":"2024-09-14T22:45:07.615230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615328+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T22:45:07.615328+0000","last_peered":"2024-09-14T22:45:07.615328+0000","last_clean":"2024-09-14T22:45:07.615328+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T22:45:07.615328+0000","last_undegraded":"2024-09-14T22:45:07.615328+0000","last_fullsized":"2024-09-14T22:45:07.615328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.610156+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T22:45:07.610156+0000","last_peered":"2024-09-14T22:45:07.610156+0000","last_clean":"2024-09-14T22:45:07.610156+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T22:45:07.610156+0000","last_undegraded":"2024-09-14T22:45:07.610156+0000","last_fullsized":"2024-09-14T22:45:07.610156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.609754+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T22:45:07.609754+0000","last_peered":"2024-09-14T22:45:07.609754+0000","last_clean":"2024-09-14T22:45:07.609754+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T22:45:07.609754+0000","last_undegraded":"2024-09-14T22:45:07.609754+0000","last_fullsized":"2024-09-14T22:45:07.609754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.606431+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T22:45:07.606431+0000","last_peered":"2024-09-14T22:45:07.606431+0000","last_clean":"2024-09-14T22:45:07.606431+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T22:45:07.606431+0000","last_undegraded":"2024-09-14T22:45:07.606431+0000","last_fullsized":"2024-09-14T22:45:07.606431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.248600+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T22:45:07.248600+0000","last_peered":"2024-09-14T22:45:07.248600+0000","last_clean":"2024-09-14T22:45:07.248600+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T22:45:07.248600+0000","last_undegraded":"2024-09-14T22:45:07.248600+0000","last_fullsized":"2024-09-14T22:45:07.248600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3822,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.249747+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T22:45:07.249747+0000","last_peered":"2024-09-14T22:45:07.249747+0000","last_clean":"2024-09-14T22:45:07.249747+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T22:45:07.249747+0000","last_undegraded":"2024-09-14T22:45:07.249747+0000","last_fullsized":"2024-09-14T22:45:07.249747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.608889+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T22:45:07.608889+0000","last_peered":"2024-09-14T22:45:07.608889+0000","last_clean":"2024-09-14T22:45:07.608889+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T22:45:07.608889+0000","last_undegraded":"2024-09-14T22:45:07.608889+0000","last_fullsized":"2024-09-14T22:45:07.608889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3892,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.599354+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T22:45:07.599354+0000","last_peered":"2024-09-14T22:45:07.599354+0000","last_clean":"2024-09-14T22:45:07.599354+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T22:45:07.599354+0000","last_undegraded":"2024-09-14T22:45:07.599354+0000","last_fullsized":"2024-09-14T22:45:07.599354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739354,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767256,"kb_used_data":5828,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":93604584,"statfs":{"total":96636764160,"available":95851094016,"internally_reserved":0,"allocated":5967872,"data_stored":3320683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":779680197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739353,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755360,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":93616480,"statfs":{"total":96636764160,"available":95863275520,"internally_reserved":0,"allocated":6565888,"data_stored":3911070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739354,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":845596,"kb_used_data":6408,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":93526244,"statfs":{"total":96636764160,"available":95770873856,"internally_reserved":0,"allocated":6561792,"data_stored":3911051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":859306437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:11.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T22:45:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:11.556 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T22:45:11.573 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":4351,"stamp":"2024-09-14T22:45:09.700593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2368212,"kb_used_data":18648,"kb_used_omap":4,"kb_used_meta":2349499,"kb_avail":280747308,"statfs":{"total":289910292480,"available":287485243392,"internally_reserved":0,"allocated":19095552,"data_stored":11142804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":2405887311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299393752,"num_objects":-115,"num_object_clones":0,"num_object_copies":-230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-115,"num_whiteouts":0,"num_read":-516897,"num_read_kb":-36076973,"num_write":-132297,"num_write_kb":-29371026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-8437760,"num_keys_recovered":-1,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615230+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T22:45:07.615230+0000","last_peered":"2024-09-14T22:45:07.615230+0000","last_clean":"2024-09-14T22:45:07.615230+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T22:45:07.615230+0000","last_undegraded":"2024-09-14T22:45:07.615230+0000","last_fullsized":"2024-09-14T22:45:07.615230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615328+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T22:45:07.615328+0000","last_peered":"2024-09-14T22:45:07.615328+0000","last_clean":"2024-09-14T22:45:07.615328+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T22:45:07.615328+0000","last_undegraded":"2024-09-14T22:45:07.615328+0000","last_fullsized":"2024-09-14T22:45:07.615328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.610156+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T22:45:07.610156+0000","last_peered":"2024-09-14T22:45:07.610156+0000","last_clean":"2024-09-14T22:45:07.610156+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T22:45:07.610156+0000","last_undegraded":"2024-09-14T22:45:07.610156+0000","last_fullsized":"2024-09-14T22:45:07.610156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.609754+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T22:45:07.609754+0000","last_peered":"2024-09-14T22:45:07.609754+0000","last_clean":"2024-09-14T22:45:07.609754+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T22:45:07.609754+0000","last_undegraded":"2024-09-14T22:45:07.609754+0000","last_fullsized":"2024-09-14T22:45:07.609754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.606431+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T22:45:07.606431+0000","last_peered":"2024-09-14T22:45:07.606431+0000","last_clean":"2024-09-14T22:45:07.606431+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T22:45:07.606431+0000","last_undegraded":"2024-09-14T22:45:07.606431+0000","last_fullsized":"2024-09-14T22:45:07.606431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.248600+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T22:45:07.248600+0000","last_peered":"2024-09-14T22:45:07.248600+0000","last_clean":"2024-09-14T22:45:07.248600+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T22:45:07.248600+0000","last_undegraded":"2024-09-14T22:45:07.248600+0000","last_fullsized":"2024-09-14T22:45:07.248600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3822,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.249747+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T22:45:07.249747+0000","last_peered":"2024-09-14T22:45:07.249747+0000","last_clean":"2024-09-14T22:45:07.249747+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T22:45:07.249747+0000","last_undegraded":"2024-09-14T22:45:07.249747+0000","last_fullsized":"2024-09-14T22:45:07.249747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.608889+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T22:45:07.608889+0000","last_peered":"2024-09-14T22:45:07.608889+0000","last_clean":"2024-09-14T22:45:07.608889+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T22:45:07.608889+0000","last_undegraded":"2024-09-14T22:45:07.608889+0000","last_fullsized":"2024-09-14T22:45:07.608889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3892,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.599354+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T22:45:07.599354+0000","last_peered":"2024-09-14T22:45:07.599354+0000","last_clean":"2024-09-14T22:45:07.599354+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T22:45:07.599354+0000","last_undegraded":"2024-09-14T22:45:07.599354+0000","last_fullsized":"2024-09-14T22:45:07.599354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739354,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767256,"kb_used_data":5828,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":93604584,"statfs":{"total":96636764160,"available":95851094016,"internally_reserved":0,"allocated":5967872,"data_stored":3320683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":779680197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739353,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755360,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":93616480,"statfs":{"total":96636764160,"available":95863275520,"internally_reserved":0,"allocated":6565888,"data_stored":3911070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739354,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":845596,"kb_used_data":6408,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":93526244,"statfs":{"total":96636764160,"available":95770873856,"internally_reserved":0,"allocated":6561792,"data_stored":3911051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":859306437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:11.574 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2024-09-14T22:45:11.575 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T22:45:11.924 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:11.925 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T22:45:11.942 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":4352,"stamp":"2024-09-14T22:45:11.700875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2368212,"kb_used_data":18648,"kb_used_omap":4,"kb_used_meta":2349499,"kb_avail":280747308,"statfs":{"total":289910292480,"available":287485243392,"internally_reserved":0,"allocated":19095552,"data_stored":11142804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":2405887311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299393752,"num_objects":-115,"num_object_clones":0,"num_object_copies":-230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-115,"num_whiteouts":0,"num_read":-516897,"num_read_kb":-36076973,"num_write":-132297,"num_write_kb":-29371026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-8437760,"num_keys_recovered":-1,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.481313"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615230+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T22:45:07.615230+0000","last_peered":"2024-09-14T22:45:07.615230+0000","last_clean":"2024-09-14T22:45:07.615230+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T22:45:07.615230+0000","last_undegraded":"2024-09-14T22:45:07.615230+0000","last_fullsized":"2024-09-14T22:45:07.615230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.615328+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T22:45:07.615328+0000","last_peered":"2024-09-14T22:45:07.615328+0000","last_clean":"2024-09-14T22:45:07.615328+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T22:45:07.615328+0000","last_undegraded":"2024-09-14T22:45:07.615328+0000","last_fullsized":"2024-09-14T22:45:07.615328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.610156+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T22:45:07.610156+0000","last_peered":"2024-09-14T22:45:07.610156+0000","last_clean":"2024-09-14T22:45:07.610156+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T22:45:07.610156+0000","last_undegraded":"2024-09-14T22:45:07.610156+0000","last_fullsized":"2024-09-14T22:45:07.610156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3823,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.609754+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T22:45:07.609754+0000","last_peered":"2024-09-14T22:45:07.609754+0000","last_clean":"2024-09-14T22:45:07.609754+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T22:45:07.609754+0000","last_undegraded":"2024-09-14T22:45:07.609754+0000","last_fullsized":"2024-09-14T22:45:07.609754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.606431+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T22:45:07.606431+0000","last_peered":"2024-09-14T22:45:07.606431+0000","last_clean":"2024-09-14T22:45:07.606431+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T22:45:07.606431+0000","last_undegraded":"2024-09-14T22:45:07.606431+0000","last_fullsized":"2024-09-14T22:45:07.606431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3821,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.248600+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T22:45:07.248600+0000","last_peered":"2024-09-14T22:45:07.248600+0000","last_clean":"2024-09-14T22:45:07.248600+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T22:45:07.248600+0000","last_undegraded":"2024-09-14T22:45:07.248600+0000","last_fullsized":"2024-09-14T22:45:07.248600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3822,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.249747+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T22:45:07.249747+0000","last_peered":"2024-09-14T22:45:07.249747+0000","last_clean":"2024-09-14T22:45:07.249747+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T22:45:07.249747+0000","last_undegraded":"2024-09-14T22:45:07.249747+0000","last_fullsized":"2024-09-14T22:45:07.249747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3824,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.608889+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T22:45:07.608889+0000","last_peered":"2024-09-14T22:45:07.608889+0000","last_clean":"2024-09-14T22:45:07.608889+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T22:45:07.608889+0000","last_undegraded":"2024-09-14T22:45:07.608889+0000","last_fullsized":"2024-09-14T22:45:07.608889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3892,"reported_epoch":1897,"state":"active+clean","last_fresh":"2024-09-14T22:45:07.599354+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T22:45:07.599354+0000","last_peered":"2024-09-14T22:45:07.599354+0000","last_clean":"2024-09-14T22:45:07.599354+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T22:45:07.599354+0000","last_undegraded":"2024-09-14T22:45:07.599354+0000","last_fullsized":"2024-09-14T22:45:07.599354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739354,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767256,"kb_used_data":5828,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":93604584,"statfs":{"total":96636764160,"available":95851094016,"internally_reserved":0,"allocated":5967872,"data_stored":3320683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":779680197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739353,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755360,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":93616480,"statfs":{"total":96636764160,"available":95863275520,"internally_reserved":0,"allocated":6565888,"data_stored":3911070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739354,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":845596,"kb_used_data":6408,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":93526244,"statfs":{"total":96636764160,"available":95770873856,"internally_reserved":0,"allocated":6561792,"data_stored":3911051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":859306437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:11.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-14T22:45:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:12.304 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1898,"fsid":"1e662d65-333f-4d02-8c8e-27508b0b0848","created":"2024-09-14T21:23:07.230127+0000","modified":"2024-09-14T22:45:09.227035+0000","last_up_change":"2024-09-14T21:23:18.140776+0000","last_in_change":"2024-09-14T21:23:08.357711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:23:18.350689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:23:22.949482+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d79904d0-f442-4d8c-ba1a-169ae3cf0298","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6809","nonce":1172764576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6811","nonce":1172764576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6815","nonce":1172764576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1172764576},{"type":"v1","addr":"172.21.15.169:6813","nonce":1172764576}]},"public_addr":"172.21.15.169:6809/1172764576","cluster_addr":"172.21.15.169:6811/1172764576","heartbeat_back_addr":"172.21.15.169:6815/1172764576","heartbeat_front_addr":"172.21.15.169:6813/1172764576","state":["exists","up"]},{"osd":1,"uuid":"a38563c5-58c2-4df4-aabd-f6266917b2d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6817","nonce":1042050961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6819","nonce":1042050961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6823","nonce":1042050961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1042050961},{"type":"v1","addr":"172.21.15.169:6821","nonce":1042050961}]},"public_addr":"172.21.15.169:6817/1042050961","cluster_addr":"172.21.15.169:6819/1042050961","heartbeat_back_addr":"172.21.15.169:6823/1042050961","heartbeat_front_addr":"172.21.15.169:6821/1042050961","state":["exists","up"]},{"osd":2,"uuid":"3834e4b1-776a-42be-a471-589e95ee253a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6801","nonce":2289461189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6803","nonce":2289461189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6807","nonce":2289461189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2289461189},{"type":"v1","addr":"172.21.15.169:6805","nonce":2289461189}]},"public_addr":"172.21.15.169:6801/2289461189","cluster_addr":"172.21.15.169:6803/2289461189","heartbeat_back_addr":"172.21.15.169:6807/2289461189","heartbeat_front_addr":"172.21.15.169:6805/2289461189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.128898+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:15.046114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:23:14.639048+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":3279,"length":1},{"begin":3285,"length":1},{"begin":3291,"length":1},{"begin":3296,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T22:45:13.323 INFO:tasks.ceph:Scrubbing cluster2.osd.0 2024-09-14T22:45:13.323 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:45:13.731 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-14T22:45:13.731 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:45:13.731 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-14T22:45:13.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 0 2024-09-14T22:45:14.111 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T22:45:14.129 INFO:tasks.ceph:Scrubbing cluster2.osd.1 2024-09-14T22:45:14.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:45:14.310 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-14T22:45:14.311 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:45:14.311 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-14T22:45:14.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 1 2024-09-14T22:45:14.678 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T22:45:14.696 INFO:tasks.ceph:Scrubbing cluster2.osd.2 2024-09-14T22:45:14.697 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:45:14.878 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-14T22:45:14.878 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:45:14.878 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-14T22:45:14.895 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 2 2024-09-14T22:45:15.242 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T22:45:15.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T22:45:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:15.610 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T22:45:15.628 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":4353,"stamp":"2024-09-14T22:45:13.701306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2368232,"kb_used_data":18668,"kb_used_omap":4,"kb_used_meta":2349499,"kb_avail":280747288,"statfs":{"total":289910292480,"available":287485222912,"internally_reserved":0,"allocated":19116032,"data_stored":11150197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":2405887311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299393752,"num_objects":-115,"num_object_clones":0,"num_object_copies":-230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-115,"num_whiteouts":0,"num_read":-516897,"num_read_kb":-36076973,"num_write":-132297,"num_write_kb":-29371026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-8437760,"num_keys_recovered":-1,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001385"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3823,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.728743+0000","last_change":"2024-09-14T21:23:26.177688+0000","last_active":"2024-09-14T22:45:12.728743+0000","last_peered":"2024-09-14T22:45:12.728743+0000","last_clean":"2024-09-14T22:45:12.728743+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T22:45:12.728743+0000","last_undegraded":"2024-09-14T22:45:12.728743+0000","last_fullsized":"2024-09-14T22:45:12.728743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:04:35.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3823,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.729690+0000","last_change":"2024-09-14T21:23:26.177403+0000","last_active":"2024-09-14T22:45:12.729690+0000","last_peered":"2024-09-14T22:45:12.729690+0000","last_clean":"2024-09-14T22:45:12.729690+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T22:45:12.729690+0000","last_undegraded":"2024-09-14T22:45:12.729690+0000","last_fullsized":"2024-09-14T22:45:12.729690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:18:05.501900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3825,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.729708+0000","last_change":"2024-09-14T21:23:26.177357+0000","last_active":"2024-09-14T22:45:12.729708+0000","last_peered":"2024-09-14T22:45:12.729708+0000","last_clean":"2024-09-14T22:45:12.729708+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T22:45:12.729708+0000","last_undegraded":"2024-09-14T22:45:12.729708+0000","last_fullsized":"2024-09-14T22:45:12.729708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3825,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.726235+0000","last_change":"2024-09-14T21:23:26.177019+0000","last_active":"2024-09-14T22:45:12.726235+0000","last_peered":"2024-09-14T22:45:12.726235+0000","last_clean":"2024-09-14T22:45:12.726235+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T22:45:12.726235+0000","last_undegraded":"2024-09-14T22:45:12.726235+0000","last_fullsized":"2024-09-14T22:45:12.726235+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:59.899302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3826,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.196971+0000","last_change":"2024-09-14T21:23:26.173406+0000","last_active":"2024-09-14T22:45:12.196971+0000","last_peered":"2024-09-14T22:45:12.196971+0000","last_clean":"2024-09-14T22:45:12.196971+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T22:45:12.196971+0000","last_undegraded":"2024-09-14T22:45:12.196971+0000","last_fullsized":"2024-09-14T22:45:12.196971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:31:21.245570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3823,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.246411+0000","last_change":"2024-09-14T21:23:26.221906+0000","last_active":"2024-09-14T22:45:09.246411+0000","last_peered":"2024-09-14T22:45:09.246411+0000","last_clean":"2024-09-14T22:45:09.246411+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T22:45:09.246411+0000","last_undegraded":"2024-09-14T22:45:09.246411+0000","last_fullsized":"2024-09-14T22:45:09.246411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:48.701301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3824,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.245827+0000","last_change":"2024-09-14T21:23:26.221833+0000","last_active":"2024-09-14T22:45:09.245827+0000","last_peered":"2024-09-14T22:45:09.245827+0000","last_clean":"2024-09-14T22:45:09.245827+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T22:45:09.245827+0000","last_undegraded":"2024-09-14T22:45:09.245827+0000","last_fullsized":"2024-09-14T22:45:09.245827+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:13:55.464254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3826,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.727238+0000","last_change":"2024-09-14T21:23:26.177017+0000","last_active":"2024-09-14T22:45:12.727238+0000","last_peered":"2024-09-14T22:45:12.727238+0000","last_clean":"2024-09-14T22:45:12.727238+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T22:45:12.727238+0000","last_undegraded":"2024-09-14T22:45:12.727238+0000","last_fullsized":"2024-09-14T22:45:12.727238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:23.155898+0000","last_clean_scrub_stamp":"2024-09-14T21:23:23.155898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T01:34:25.409351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3894,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:12.724534+0000","last_change":"2024-09-14T21:23:20.154483+0000","last_active":"2024-09-14T22:45:12.724534+0000","last_peered":"2024-09-14T22:45:12.724534+0000","last_clean":"2024-09-14T22:45:12.724534+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T22:45:12.724534+0000","last_undegraded":"2024-09-14T22:45:12.724534+0000","last_fullsized":"2024-09-14T22:45:12.724534+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:23:19.141866+0000","last_clean_scrub_stamp":"2024-09-14T21:23:19.141866+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:10:24.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739355,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767264,"kb_used_data":5836,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":93604576,"statfs":{"total":96636764160,"available":95851085824,"internally_reserved":0,"allocated":5976064,"data_stored":3324370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":779680197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739354,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755360,"kb_used_data":6412,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":93616480,"statfs":{"total":96636764160,"available":95863275520,"internally_reserved":0,"allocated":6565888,"data_stored":3911070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739355,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":845608,"kb_used_data":6420,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":93526232,"statfs":{"total":96636764160,"available":95770861568,"internally_reserved":0,"allocated":6574080,"data_stored":3914757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":859306437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:15.631 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.631 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T21:23:23.155898+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=23, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T21:23:19.141866+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=23, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:45:15.632 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T22:45:35.634 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-14T22:45:35.991 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-14T22:45:35.991 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-09-14T22:45:36.009 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":4364,"stamp":"2024-09-14T22:45:35.706242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2368228,"kb_used_data":18676,"kb_used_omap":4,"kb_used_meta":2349499,"kb_avail":280747292,"statfs":{"total":289910292480,"available":287485227008,"internally_reserved":0,"allocated":19124224,"data_stored":11153884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":2405887311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002643"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3831,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:20.557613+0000","last_change":"2024-09-14T22:45:20.557613+0000","last_active":"2024-09-14T22:45:20.557613+0000","last_peered":"2024-09-14T22:45:20.557613+0000","last_clean":"2024-09-14T22:45:20.557613+0000","last_became_active":"2024-09-14T21:23:24.168788+0000","last_became_peered":"2024-09-14T21:23:24.168788+0000","last_unstale":"2024-09-14T22:45:20.557613+0000","last_undegraded":"2024-09-14T22:45:20.557613+0000","last_fullsized":"2024-09-14T22:45:20.557613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:20.557484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:20.557484+0000","last_clean_scrub_stamp":"2024-09-14T22:45:20.557484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:59:00.885421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0013528520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3831,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:18.612890+0000","last_change":"2024-09-14T22:45:18.612890+0000","last_active":"2024-09-14T22:45:18.612890+0000","last_peered":"2024-09-14T22:45:18.612890+0000","last_clean":"2024-09-14T22:45:18.612890+0000","last_became_active":"2024-09-14T21:23:24.168623+0000","last_became_peered":"2024-09-14T21:23:24.168623+0000","last_unstale":"2024-09-14T22:45:18.612890+0000","last_undegraded":"2024-09-14T22:45:18.612890+0000","last_fullsized":"2024-09-14T22:45:18.612890+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:18.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:18.612787+0000","last_clean_scrub_stamp":"2024-09-14T22:45:18.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:30:12.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010747230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3833,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:17.597014+0000","last_change":"2024-09-14T22:45:17.597014+0000","last_active":"2024-09-14T22:45:17.597014+0000","last_peered":"2024-09-14T22:45:17.597014+0000","last_clean":"2024-09-14T22:45:17.597014+0000","last_became_active":"2024-09-14T21:23:24.167900+0000","last_became_peered":"2024-09-14T21:23:24.167900+0000","last_unstale":"2024-09-14T22:45:17.597014+0000","last_undegraded":"2024-09-14T22:45:17.597014+0000","last_fullsized":"2024-09-14T22:45:17.597014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:17.596926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:17.596926+0000","last_clean_scrub_stamp":"2024-09-14T22:45:17.596926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:35:36.897711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011680550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3833,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:19.577244+0000","last_change":"2024-09-14T22:45:19.577244+0000","last_active":"2024-09-14T22:45:19.577244+0000","last_peered":"2024-09-14T22:45:19.577244+0000","last_clean":"2024-09-14T22:45:19.577244+0000","last_became_active":"2024-09-14T21:23:24.167694+0000","last_became_peered":"2024-09-14T21:23:24.167694+0000","last_unstale":"2024-09-14T22:45:19.577244+0000","last_undegraded":"2024-09-14T22:45:19.577244+0000","last_fullsized":"2024-09-14T22:45:19.577244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:19.577141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:19.577141+0000","last_clean_scrub_stamp":"2024-09-14T22:45:19.577141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:09:25.320480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086094399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"1898'3","reported_seq":3835,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:14.322799+0000","last_change":"2024-09-14T22:45:14.322799+0000","last_active":"2024-09-14T22:45:14.322799+0000","last_peered":"2024-09-14T22:45:14.322799+0000","last_clean":"2024-09-14T22:45:14.322799+0000","last_became_active":"2024-09-14T21:23:24.167454+0000","last_became_peered":"2024-09-14T21:23:24.167454+0000","last_unstale":"2024-09-14T22:45:14.322799+0000","last_undegraded":"2024-09-14T22:45:14.322799+0000","last_fullsized":"2024-09-14T22:45:14.322799+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"1898'3","last_scrub_stamp":"2024-09-14T22:45:14.322741+0000","last_deep_scrub":"1898'3","last_deep_scrub_stamp":"2024-09-14T22:45:14.322741+0000","last_clean_scrub_stamp":"2024-09-14T22:45:14.322741+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:32:44.008790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00050571500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3831,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:16.451861+0000","last_change":"2024-09-14T22:45:16.451861+0000","last_active":"2024-09-14T22:45:16.451861+0000","last_peered":"2024-09-14T22:45:16.451861+0000","last_clean":"2024-09-14T22:45:16.451861+0000","last_became_active":"2024-09-14T21:23:24.170659+0000","last_became_peered":"2024-09-14T21:23:24.170659+0000","last_unstale":"2024-09-14T22:45:16.451861+0000","last_undegraded":"2024-09-14T22:45:16.451861+0000","last_fullsized":"2024-09-14T22:45:16.451861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:16.451774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:16.451774+0000","last_clean_scrub_stamp":"2024-09-14T22:45:16.451774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:33:47.045083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050992599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3832,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:15.404008+0000","last_change":"2024-09-14T22:45:15.404008+0000","last_active":"2024-09-14T22:45:15.404008+0000","last_peered":"2024-09-14T22:45:15.404008+0000","last_clean":"2024-09-14T22:45:15.404008+0000","last_became_active":"2024-09-14T21:23:24.170642+0000","last_became_peered":"2024-09-14T21:23:24.170642+0000","last_unstale":"2024-09-14T22:45:15.404008+0000","last_undegraded":"2024-09-14T22:45:15.404008+0000","last_fullsized":"2024-09-14T22:45:15.404008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:45:15.403913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:45:15.403913+0000","last_clean_scrub_stamp":"2024-09-14T22:45:15.403913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:55:02.599134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047489299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"1898'2","reported_seq":3835,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:15.677324+0000","last_change":"2024-09-14T22:45:15.677324+0000","last_active":"2024-09-14T22:45:15.677324+0000","last_peered":"2024-09-14T22:45:15.677324+0000","last_clean":"2024-09-14T22:45:15.677324+0000","last_became_active":"2024-09-14T21:23:24.167751+0000","last_became_peered":"2024-09-14T21:23:24.167751+0000","last_unstale":"2024-09-14T22:45:15.677324+0000","last_undegraded":"2024-09-14T22:45:15.677324+0000","last_fullsized":"2024-09-14T22:45:15.677324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"1898'2","last_scrub_stamp":"2024-09-14T22:45:15.677256+0000","last_deep_scrub":"1898'2","last_deep_scrub_stamp":"2024-09-14T22:45:15.677256+0000","last_clean_scrub_stamp":"2024-09-14T22:45:15.677256+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:04:13.060162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00088444900000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"1898'54","reported_seq":3904,"reported_epoch":1898,"state":"active+clean","last_fresh":"2024-09-14T22:45:16.649328+0000","last_change":"2024-09-14T22:45:16.649328+0000","last_active":"2024-09-14T22:45:16.649328+0000","last_peered":"2024-09-14T22:45:16.649328+0000","last_clean":"2024-09-14T22:45:16.649328+0000","last_became_active":"2024-09-14T21:23:20.154107+0000","last_became_peered":"2024-09-14T21:23:20.154107+0000","last_unstale":"2024-09-14T22:45:16.649328+0000","last_undegraded":"2024-09-14T22:45:16.649328+0000","last_fullsized":"2024-09-14T22:45:16.649328+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"1898'54","last_scrub_stamp":"2024-09-14T22:45:16.649229+0000","last_deep_scrub":"1898'54","last_deep_scrub_stamp":"2024-09-14T22:45:16.649229+0000","last_clean_scrub_stamp":"2024-09-14T22:45:16.649229+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:37:43.646204+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739359,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767260,"kb_used_data":5836,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":93604580,"statfs":{"total":96636764160,"available":95851089920,"internally_reserved":0,"allocated":5976064,"data_stored":3324370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":779680197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739358,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755364,"kb_used_data":6420,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":93616476,"statfs":{"total":96636764160,"available":95863271424,"internally_reserved":0,"allocated":6574080,"data_stored":3914757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739359,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":845604,"kb_used_data":6420,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":93526236,"statfs":{"total":96636764160,"available":95770865664,"internally_reserved":0,"allocated":6574080,"data_stored":3914757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":859306437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:36.011 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster cluster2 config set global mon_health_to_clog false 2024-09-14T22:45:36.378 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T22:45:36.378 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T22:45:36.379 DEBUG:tasks.ceph.cluster2.osd.0:waiting for process to exit 2024-09-14T22:45:36.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:38.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~0s 2024-09-14T22:45:42.481 INFO:tasks.ceph.cluster2.osd.0:Stopped 2024-09-14T22:45:42.481 DEBUG:tasks.ceph.cluster2.osd.1:waiting for process to exit 2024-09-14T22:45:42.481 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:43.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~0s 2024-09-14T22:45:43.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 has been restored 2024-09-14T22:45:48.583 INFO:tasks.ceph.cluster2.osd.1:Stopped 2024-09-14T22:45:48.584 DEBUG:tasks.ceph.cluster2.osd.2:waiting for process to exit 2024-09-14T22:45:48.584 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:49.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.2 is failed for ~0s 2024-09-14T22:45:49.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 has been restored 2024-09-14T22:45:54.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.2 is failed for ~5s 2024-09-14T22:45:54.686 INFO:tasks.ceph.cluster2.osd.2:Stopped 2024-09-14T22:45:54.686 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T22:45:54.686 DEBUG:tasks.ceph.cluster2.mgr.x:waiting for process to exit 2024-09-14T22:45:54.687 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:54.767 INFO:tasks.ceph.cluster2.mgr.x:Stopped 2024-09-14T22:45:54.767 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T22:45:54.767 DEBUG:tasks.ceph.cluster2.mon.a:waiting for process to exit 2024-09-14T22:45:54.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:45:54.807 INFO:tasks.ceph.cluster2.mon.a:Stopped 2024-09-14T22:45:54.807 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T22:45:54.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cluster2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-14T22:45:54.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-0 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T22:45:54.972 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-0 2024-09-14T22:45:55.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T22:45:55.175 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-1 2024-09-14T22:45:55.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T22:45:55.303 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-2 2024-09-14T22:45:55.437 INFO:tasks.ceph:Archiving mon data... 2024-09-14T22:45:55.439 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/cluster2-a to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/data/cluster2.mon.a.tgz 2024-09-14T22:45:55.439 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-14T22:45:55.486 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.dvpwQ9bJPf 2024-09-14T22:45:55.486 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/cluster2-a -- . > /tmp/tmp.dvpwQ9bJPf 2024-09-14T22:45:55.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.dvpwQ9bJPf 2024-09-14T22:45:55.800 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.dvpwQ9bJPf is 519KB 2024-09-14T22:45:55.892 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.dvpwQ9bJPf 2024-09-14T22:45:55.926 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T22:45:55.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/cluster2.conf /etc/ceph/cluster2.keyring /home/ubuntu/cephtest/cluster2.data /home/ubuntu/cephtest/cluster2.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T22:45:55.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/cluster2.conf /etc/ceph/cluster2.keyring /home/ubuntu/cephtest/cluster2.data /home/ubuntu/cephtest/cluster2.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T22:45:56.177 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T22:45:56.187 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2024-09-14T22:45:56.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T22:45:56.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:45:56.772 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T22:45:56.790 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":4420,"stamp":"2024-09-14T22:45:55.692520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3709616,"kb_used_data":14764,"kb_used_omap":4,"kb_used_meta":3694779,"kb_avail":279405904,"statfs":{"total":289910292480,"available":286111645696,"internally_reserved":0,"allocated":15118336,"data_stored":8658874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":3783454037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.043439+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T22:45:09.043439+0000","last_peered":"2024-09-14T22:45:09.043439+0000","last_clean":"2024-09-14T22:45:09.043439+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T22:45:09.043439+0000","last_undegraded":"2024-09-14T22:45:09.043439+0000","last_fullsized":"2024-09-14T22:45:09.043439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.039165+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T22:45:09.039165+0000","last_peered":"2024-09-14T22:45:09.039165+0000","last_clean":"2024-09-14T22:45:09.039165+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T22:45:09.039165+0000","last_undegraded":"2024-09-14T22:45:09.039165+0000","last_fullsized":"2024-09-14T22:45:09.039165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.041948+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T22:45:09.041948+0000","last_peered":"2024-09-14T22:45:09.041948+0000","last_clean":"2024-09-14T22:45:09.041948+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.041948+0000","last_undegraded":"2024-09-14T22:45:09.041948+0000","last_fullsized":"2024-09-14T22:45:09.041948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.036241+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T22:45:09.036241+0000","last_peered":"2024-09-14T22:45:09.036241+0000","last_clean":"2024-09-14T22:45:09.036241+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T22:45:09.036241+0000","last_undegraded":"2024-09-14T22:45:09.036241+0000","last_fullsized":"2024-09-14T22:45:09.036241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.037093+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T22:45:09.037093+0000","last_peered":"2024-09-14T22:45:09.037093+0000","last_clean":"2024-09-14T22:45:09.037093+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.037093+0000","last_undegraded":"2024-09-14T22:45:09.037093+0000","last_fullsized":"2024-09-14T22:45:09.037093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203465+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T22:45:08.203465+0000","last_peered":"2024-09-14T22:45:08.203465+0000","last_clean":"2024-09-14T22:45:08.203465+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T22:45:08.203465+0000","last_undegraded":"2024-09-14T22:45:08.203465+0000","last_fullsized":"2024-09-14T22:45:08.203465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3879,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203292+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T22:45:08.203292+0000","last_peered":"2024-09-14T22:45:08.203292+0000","last_clean":"2024-09-14T22:45:08.203292+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T22:45:08.203292+0000","last_undegraded":"2024-09-14T22:45:08.203292+0000","last_fullsized":"2024-09-14T22:45:08.203292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.031912+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T22:45:09.031912+0000","last_peered":"2024-09-14T22:45:09.031912+0000","last_clean":"2024-09-14T22:45:09.031912+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T22:45:09.031912+0000","last_undegraded":"2024-09-14T22:45:09.031912+0000","last_fullsized":"2024-09-14T22:45:09.031912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3947,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.034021+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T22:45:09.034021+0000","last_peered":"2024-09-14T22:45:09.034021+0000","last_clean":"2024-09-14T22:45:09.034021+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T22:45:09.034021+0000","last_undegraded":"2024-09-14T22:45:09.034021+0000","last_fullsized":"2024-09-14T22:45:09.034021+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1172748,"kb_used_data":4532,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93199092,"statfs":{"total":96636764160,"available":95435870208,"internally_reserved":0,"allocated":4640768,"data_stored":2492700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169168,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1164030,"kb_avail":93202672,"statfs":{"total":96636764160,"available":95439536128,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1191967173},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1367700,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1362558,"kb_avail":93004140,"statfs":{"total":96636764160,"available":95236239360,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1395259851},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:56.791 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T22:45:57.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:45:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T22:45:57.170 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":4420,"stamp":"2024-09-14T22:45:55.692520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3709616,"kb_used_data":14764,"kb_used_omap":4,"kb_used_meta":3694779,"kb_avail":279405904,"statfs":{"total":289910292480,"available":286111645696,"internally_reserved":0,"allocated":15118336,"data_stored":8658874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":3783454037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.043439+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T22:45:09.043439+0000","last_peered":"2024-09-14T22:45:09.043439+0000","last_clean":"2024-09-14T22:45:09.043439+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T22:45:09.043439+0000","last_undegraded":"2024-09-14T22:45:09.043439+0000","last_fullsized":"2024-09-14T22:45:09.043439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.039165+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T22:45:09.039165+0000","last_peered":"2024-09-14T22:45:09.039165+0000","last_clean":"2024-09-14T22:45:09.039165+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T22:45:09.039165+0000","last_undegraded":"2024-09-14T22:45:09.039165+0000","last_fullsized":"2024-09-14T22:45:09.039165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.041948+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T22:45:09.041948+0000","last_peered":"2024-09-14T22:45:09.041948+0000","last_clean":"2024-09-14T22:45:09.041948+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.041948+0000","last_undegraded":"2024-09-14T22:45:09.041948+0000","last_fullsized":"2024-09-14T22:45:09.041948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.036241+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T22:45:09.036241+0000","last_peered":"2024-09-14T22:45:09.036241+0000","last_clean":"2024-09-14T22:45:09.036241+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T22:45:09.036241+0000","last_undegraded":"2024-09-14T22:45:09.036241+0000","last_fullsized":"2024-09-14T22:45:09.036241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.037093+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T22:45:09.037093+0000","last_peered":"2024-09-14T22:45:09.037093+0000","last_clean":"2024-09-14T22:45:09.037093+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.037093+0000","last_undegraded":"2024-09-14T22:45:09.037093+0000","last_fullsized":"2024-09-14T22:45:09.037093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203465+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T22:45:08.203465+0000","last_peered":"2024-09-14T22:45:08.203465+0000","last_clean":"2024-09-14T22:45:08.203465+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T22:45:08.203465+0000","last_undegraded":"2024-09-14T22:45:08.203465+0000","last_fullsized":"2024-09-14T22:45:08.203465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3879,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203292+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T22:45:08.203292+0000","last_peered":"2024-09-14T22:45:08.203292+0000","last_clean":"2024-09-14T22:45:08.203292+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T22:45:08.203292+0000","last_undegraded":"2024-09-14T22:45:08.203292+0000","last_fullsized":"2024-09-14T22:45:08.203292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.031912+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T22:45:09.031912+0000","last_peered":"2024-09-14T22:45:09.031912+0000","last_clean":"2024-09-14T22:45:09.031912+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T22:45:09.031912+0000","last_undegraded":"2024-09-14T22:45:09.031912+0000","last_fullsized":"2024-09-14T22:45:09.031912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3947,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.034021+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T22:45:09.034021+0000","last_peered":"2024-09-14T22:45:09.034021+0000","last_clean":"2024-09-14T22:45:09.034021+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T22:45:09.034021+0000","last_undegraded":"2024-09-14T22:45:09.034021+0000","last_fullsized":"2024-09-14T22:45:09.034021+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1172748,"kb_used_data":4532,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93199092,"statfs":{"total":96636764160,"available":95435870208,"internally_reserved":0,"allocated":4640768,"data_stored":2492700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169168,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1164030,"kb_avail":93202672,"statfs":{"total":96636764160,"available":95439536128,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1191967173},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1367700,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1362558,"kb_avail":93004140,"statfs":{"total":96636764160,"available":95236239360,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1395259851},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:57.171 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2024-09-14T22:45:57.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T22:45:57.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:45:57.532 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T22:45:57.548 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":4420,"stamp":"2024-09-14T22:45:55.692520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3709616,"kb_used_data":14764,"kb_used_omap":4,"kb_used_meta":3694779,"kb_avail":279405904,"statfs":{"total":289910292480,"available":286111645696,"internally_reserved":0,"allocated":15118336,"data_stored":8658874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":3783454037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.043439+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T22:45:09.043439+0000","last_peered":"2024-09-14T22:45:09.043439+0000","last_clean":"2024-09-14T22:45:09.043439+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T22:45:09.043439+0000","last_undegraded":"2024-09-14T22:45:09.043439+0000","last_fullsized":"2024-09-14T22:45:09.043439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.039165+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T22:45:09.039165+0000","last_peered":"2024-09-14T22:45:09.039165+0000","last_clean":"2024-09-14T22:45:09.039165+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T22:45:09.039165+0000","last_undegraded":"2024-09-14T22:45:09.039165+0000","last_fullsized":"2024-09-14T22:45:09.039165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.041948+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T22:45:09.041948+0000","last_peered":"2024-09-14T22:45:09.041948+0000","last_clean":"2024-09-14T22:45:09.041948+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.041948+0000","last_undegraded":"2024-09-14T22:45:09.041948+0000","last_fullsized":"2024-09-14T22:45:09.041948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.036241+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T22:45:09.036241+0000","last_peered":"2024-09-14T22:45:09.036241+0000","last_clean":"2024-09-14T22:45:09.036241+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T22:45:09.036241+0000","last_undegraded":"2024-09-14T22:45:09.036241+0000","last_fullsized":"2024-09-14T22:45:09.036241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.037093+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T22:45:09.037093+0000","last_peered":"2024-09-14T22:45:09.037093+0000","last_clean":"2024-09-14T22:45:09.037093+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.037093+0000","last_undegraded":"2024-09-14T22:45:09.037093+0000","last_fullsized":"2024-09-14T22:45:09.037093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203465+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T22:45:08.203465+0000","last_peered":"2024-09-14T22:45:08.203465+0000","last_clean":"2024-09-14T22:45:08.203465+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T22:45:08.203465+0000","last_undegraded":"2024-09-14T22:45:08.203465+0000","last_fullsized":"2024-09-14T22:45:08.203465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3879,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203292+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T22:45:08.203292+0000","last_peered":"2024-09-14T22:45:08.203292+0000","last_clean":"2024-09-14T22:45:08.203292+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T22:45:08.203292+0000","last_undegraded":"2024-09-14T22:45:08.203292+0000","last_fullsized":"2024-09-14T22:45:08.203292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.031912+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T22:45:09.031912+0000","last_peered":"2024-09-14T22:45:09.031912+0000","last_clean":"2024-09-14T22:45:09.031912+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T22:45:09.031912+0000","last_undegraded":"2024-09-14T22:45:09.031912+0000","last_fullsized":"2024-09-14T22:45:09.031912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3947,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.034021+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T22:45:09.034021+0000","last_peered":"2024-09-14T22:45:09.034021+0000","last_clean":"2024-09-14T22:45:09.034021+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T22:45:09.034021+0000","last_undegraded":"2024-09-14T22:45:09.034021+0000","last_fullsized":"2024-09-14T22:45:09.034021+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1172748,"kb_used_data":4532,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93199092,"statfs":{"total":96636764160,"available":95435870208,"internally_reserved":0,"allocated":4640768,"data_stored":2492700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169168,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1164030,"kb_avail":93202672,"statfs":{"total":96636764160,"available":95439536128,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1191967173},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1367700,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1362558,"kb_avail":93004140,"statfs":{"total":96636764160,"available":95236239360,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1395259851},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:45:57.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-14T22:45:57.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:45:57.910 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1924,"fsid":"2e86c927-73e2-48b0-b6e4-a356a5cdc207","created":"2024-09-14T21:22:27.085248+0000","modified":"2024-09-14T22:45:08.197861+0000","last_up_change":"2024-09-14T21:22:38.244211+0000","last_in_change":"2024-09-14T21:22:28.223419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T21:22:38.403379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T21:22:42.840815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"617183d8-d16e-4af2-8ace-d92b5a6cfa71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6813","nonce":1669524686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6817","nonce":1669524686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6823","nonce":1669524686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":1669524686},{"type":"v1","addr":"172.21.15.63:6820","nonce":1669524686}]},"public_addr":"172.21.15.63:6813/1669524686","cluster_addr":"172.21.15.63:6817/1669524686","heartbeat_back_addr":"172.21.15.63:6823/1669524686","heartbeat_front_addr":"172.21.15.63:6820/1669524686","state":["exists","up"]},{"osd":1,"uuid":"5dc414c5-c4f8-49f7-8dc7-dcac0d34a840","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6801","nonce":2907331463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6803","nonce":2907331463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6807","nonce":2907331463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2907331463},{"type":"v1","addr":"172.21.15.63:6805","nonce":2907331463}]},"public_addr":"172.21.15.63:6801/2907331463","cluster_addr":"172.21.15.63:6803/2907331463","heartbeat_back_addr":"172.21.15.63:6807/2907331463","heartbeat_front_addr":"172.21.15.63:6805/2907331463","state":["exists","up"]},{"osd":2,"uuid":"1f79ab3f-f676-489c-b6a7-523a035ef95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6809","nonce":2572181379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6812","nonce":2572181379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6821","nonce":2572181379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2572181379},{"type":"v1","addr":"172.21.15.63:6816","nonce":2572181379}]},"public_addr":"172.21.15.63:6809/2572181379","cluster_addr":"172.21.15.63:6812/2572181379","heartbeat_back_addr":"172.21.15.63:6821/2572181379","heartbeat_front_addr":"172.21.15.63:6816/2572181379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.981624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.685698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T21:22:34.964714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":2979,"length":2},{"begin":2989,"length":1},{"begin":2999,"length":1},{"begin":3272,"length":1},{"begin":3295,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T22:45:58.928 INFO:tasks.ceph:Scrubbing cluster1.osd.0 2024-09-14T22:45:58.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:45:59.123 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-14T22:45:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:45:59.123 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-14T22:45:59.139 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 0 2024-09-14T22:45:59.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.2 has been restored 2024-09-14T22:45:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T22:45:59.519 INFO:tasks.ceph:Scrubbing cluster1.osd.1 2024-09-14T22:45:59.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:45:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-14T22:45:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:45:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-14T22:45:59.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 1 2024-09-14T22:46:00.078 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T22:46:00.096 INFO:tasks.ceph:Scrubbing cluster1.osd.2 2024-09-14T22:46:00.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T22:46:00.280 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-14T22:46:00.281 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T22:46:00.281 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-14T22:46:00.295 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 2 2024-09-14T22:46:00.659 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T22:46:00.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T22:46:01.037 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:46:01.038 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T22:46:01.055 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":4422,"stamp":"2024-09-14T22:45:59.693200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3709616,"kb_used_data":14764,"kb_used_omap":4,"kb_used_meta":3694779,"kb_avail":279405904,"statfs":{"total":289910292480,"available":286111645696,"internally_reserved":0,"allocated":15118336,"data_stored":8658874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":3783454037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002440"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.043439+0000","last_change":"2024-09-14T21:22:46.294300+0000","last_active":"2024-09-14T22:45:09.043439+0000","last_peered":"2024-09-14T22:45:09.043439+0000","last_clean":"2024-09-14T22:45:09.043439+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T22:45:09.043439+0000","last_undegraded":"2024-09-14T22:45:09.043439+0000","last_fullsized":"2024-09-14T22:45:09.043439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:05.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3876,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.039165+0000","last_change":"2024-09-14T21:22:46.294655+0000","last_active":"2024-09-14T22:45:09.039165+0000","last_peered":"2024-09-14T22:45:09.039165+0000","last_clean":"2024-09-14T22:45:09.039165+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T22:45:09.039165+0000","last_undegraded":"2024-09-14T22:45:09.039165+0000","last_fullsized":"2024-09-14T22:45:09.039165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:47:12.566808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.041948+0000","last_change":"2024-09-14T21:22:46.294022+0000","last_active":"2024-09-14T22:45:09.041948+0000","last_peered":"2024-09-14T22:45:09.041948+0000","last_clean":"2024-09-14T22:45:09.041948+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.041948+0000","last_undegraded":"2024-09-14T22:45:09.041948+0000","last_fullsized":"2024-09-14T22:45:09.041948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:55:30.458636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.036241+0000","last_change":"2024-09-14T21:22:46.294352+0000","last_active":"2024-09-14T22:45:09.036241+0000","last_peered":"2024-09-14T22:45:09.036241+0000","last_clean":"2024-09-14T22:45:09.036241+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T22:45:09.036241+0000","last_undegraded":"2024-09-14T22:45:09.036241+0000","last_fullsized":"2024-09-14T22:45:09.036241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:31.386028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.037093+0000","last_change":"2024-09-14T21:22:46.286321+0000","last_active":"2024-09-14T22:45:09.037093+0000","last_peered":"2024-09-14T22:45:09.037093+0000","last_clean":"2024-09-14T22:45:09.037093+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:45:09.037093+0000","last_undegraded":"2024-09-14T22:45:09.037093+0000","last_fullsized":"2024-09-14T22:45:09.037093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:06:36.237122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3877,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203465+0000","last_change":"2024-09-14T21:22:46.920843+0000","last_active":"2024-09-14T22:45:08.203465+0000","last_peered":"2024-09-14T22:45:08.203465+0000","last_clean":"2024-09-14T22:45:08.203465+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T22:45:08.203465+0000","last_undegraded":"2024-09-14T22:45:08.203465+0000","last_fullsized":"2024-09-14T22:45:08.203465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:52:16.593331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3879,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:08.203292+0000","last_change":"2024-09-14T21:22:46.920846+0000","last_active":"2024-09-14T22:45:08.203292+0000","last_peered":"2024-09-14T22:45:08.203292+0000","last_clean":"2024-09-14T22:45:08.203292+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T22:45:08.203292+0000","last_undegraded":"2024-09-14T22:45:08.203292+0000","last_fullsized":"2024-09-14T22:45:08.203292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:54:31.217920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":3878,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.031912+0000","last_change":"2024-09-14T21:22:46.293944+0000","last_active":"2024-09-14T22:45:09.031912+0000","last_peered":"2024-09-14T22:45:09.031912+0000","last_clean":"2024-09-14T22:45:09.031912+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T22:45:09.031912+0000","last_undegraded":"2024-09-14T22:45:09.031912+0000","last_fullsized":"2024-09-14T22:45:09.031912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:43.265891+0000","last_clean_scrub_stamp":"2024-09-14T21:22:43.265891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:17:18.802072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":3947,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:45:09.034021+0000","last_change":"2024-09-14T21:22:40.257094+0000","last_active":"2024-09-14T22:45:09.034021+0000","last_peered":"2024-09-14T22:45:09.034021+0000","last_clean":"2024-09-14T22:45:09.034021+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T22:45:09.034021+0000","last_undegraded":"2024-09-14T22:45:09.034021+0000","last_fullsized":"2024-09-14T22:45:09.034021+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T21:22:39.245894+0000","last_clean_scrub_stamp":"2024-09-14T21:22:39.245894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.055306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1172748,"kb_used_data":4532,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93199092,"statfs":{"total":96636764160,"available":95435870208,"internally_reserved":0,"allocated":4640768,"data_stored":2492700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169168,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1164030,"kb_avail":93202672,"statfs":{"total":96636764160,"available":95439536128,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1191967173},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1367700,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1362558,"kb_avail":93004140,"statfs":{"total":96636764160,"available":95236239360,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1395259851},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:46:01.056 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.056 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.056 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.056 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T21:22:43.265891+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T21:22:39.245894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=21, tm_min=22, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=22, tm_min=45, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T22:46:01.057 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T22:46:21.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-14T22:46:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-14T22:46:21.431 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-14T22:46:21.448 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":4432,"stamp":"2024-09-14T22:46:19.697083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3713756,"kb_used_data":14764,"kb_used_omap":4,"kb_used_meta":3698939,"kb_avail":279401764,"statfs":{"total":289910292480,"available":286107406336,"internally_reserved":0,"allocated":15118336,"data_stored":8658874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":3787713877},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002374"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":3884,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:04.088446+0000","last_change":"2024-09-14T22:46:04.088446+0000","last_active":"2024-09-14T22:46:04.088446+0000","last_peered":"2024-09-14T22:46:04.088446+0000","last_clean":"2024-09-14T22:46:04.088446+0000","last_became_active":"2024-09-14T21:22:44.287121+0000","last_became_peered":"2024-09-14T21:22:44.287121+0000","last_unstale":"2024-09-14T22:46:04.088446+0000","last_undegraded":"2024-09-14T22:46:04.088446+0000","last_fullsized":"2024-09-14T22:46:04.088446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:04.088360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:04.088360+0000","last_clean_scrub_stamp":"2024-09-14T22:46:04.088360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:53:55.046001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011733399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":3884,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:06.092845+0000","last_change":"2024-09-14T22:46:06.092845+0000","last_active":"2024-09-14T22:46:06.092845+0000","last_peered":"2024-09-14T22:46:06.092845+0000","last_clean":"2024-09-14T22:46:06.092845+0000","last_became_active":"2024-09-14T21:22:44.283577+0000","last_became_peered":"2024-09-14T21:22:44.283577+0000","last_unstale":"2024-09-14T22:46:06.092845+0000","last_undegraded":"2024-09-14T22:46:06.092845+0000","last_fullsized":"2024-09-14T22:46:06.092845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:06.092746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:06.092746+0000","last_clean_scrub_stamp":"2024-09-14T22:46:06.092746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T02:13:44.991801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001217636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3885,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:05.098415+0000","last_change":"2024-09-14T22:46:05.098415+0000","last_active":"2024-09-14T22:46:05.098415+0000","last_peered":"2024-09-14T22:46:05.098415+0000","last_clean":"2024-09-14T22:46:05.098415+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:46:05.098415+0000","last_undegraded":"2024-09-14T22:46:05.098415+0000","last_fullsized":"2024-09-14T22:46:05.098415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:05.098319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:05.098319+0000","last_clean_scrub_stamp":"2024-09-14T22:46:05.098319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:35.683507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00093636900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3886,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:03.097311+0000","last_change":"2024-09-14T22:46:03.097254+0000","last_active":"2024-09-14T22:46:03.097311+0000","last_peered":"2024-09-14T22:46:03.097311+0000","last_clean":"2024-09-14T22:46:03.097311+0000","last_became_active":"2024-09-14T21:22:44.287055+0000","last_became_peered":"2024-09-14T21:22:44.287055+0000","last_unstale":"2024-09-14T22:46:03.097311+0000","last_undegraded":"2024-09-14T22:46:03.097311+0000","last_fullsized":"2024-09-14T22:46:03.097311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:03.097049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:03.097049+0000","last_clean_scrub_stamp":"2024-09-14T22:46:03.097049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:52.500077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011573270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"1924'3","reported_seq":3888,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:00.509608+0000","last_change":"2024-09-14T22:46:00.509553+0000","last_active":"2024-09-14T22:46:00.509608+0000","last_peered":"2024-09-14T22:46:00.509608+0000","last_clean":"2024-09-14T22:46:00.509608+0000","last_became_active":"2024-09-14T21:22:44.283478+0000","last_became_peered":"2024-09-14T21:22:44.283478+0000","last_unstale":"2024-09-14T22:46:00.509608+0000","last_undegraded":"2024-09-14T22:46:00.509608+0000","last_fullsized":"2024-09-14T22:46:00.509608+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"1924'3","last_scrub_stamp":"2024-09-14T22:46:00.509479+0000","last_deep_scrub":"1924'3","last_deep_scrub_stamp":"2024-09-14T22:46:00.509479+0000","last_clean_scrub_stamp":"2024-09-14T22:46:00.509479+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:05:09.690675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00055003400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3886,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:01.628915+0000","last_change":"2024-09-14T22:46:01.628861+0000","last_active":"2024-09-14T22:46:01.628915+0000","last_peered":"2024-09-14T22:46:01.628915+0000","last_clean":"2024-09-14T22:46:01.628915+0000","last_became_active":"2024-09-14T21:22:44.283361+0000","last_became_peered":"2024-09-14T21:22:44.283361+0000","last_unstale":"2024-09-14T22:46:01.628915+0000","last_undegraded":"2024-09-14T22:46:01.628915+0000","last_fullsized":"2024-09-14T22:46:01.628915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:01.628778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:01.628778+0000","last_clean_scrub_stamp":"2024-09-14T22:46:01.628778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:37:01.654940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043336900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3887,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:02.603940+0000","last_change":"2024-09-14T22:46:02.603940+0000","last_active":"2024-09-14T22:46:02.603940+0000","last_peered":"2024-09-14T22:46:02.603940+0000","last_clean":"2024-09-14T22:46:02.603940+0000","last_became_active":"2024-09-14T21:22:44.284230+0000","last_became_peered":"2024-09-14T21:22:44.284230+0000","last_unstale":"2024-09-14T22:46:02.603940+0000","last_undegraded":"2024-09-14T22:46:02.603940+0000","last_fullsized":"2024-09-14T22:46:02.603940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T22:46:02.603855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T22:46:02.603855+0000","last_clean_scrub_stamp":"2024-09-14T22:46:02.603855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:35:10.173416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044017900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"1924'2","reported_seq":3888,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:02.058575+0000","last_change":"2024-09-14T22:46:02.058511+0000","last_active":"2024-09-14T22:46:02.058575+0000","last_peered":"2024-09-14T22:46:02.058575+0000","last_clean":"2024-09-14T22:46:02.058575+0000","last_became_active":"2024-09-14T21:22:44.285232+0000","last_became_peered":"2024-09-14T21:22:44.285232+0000","last_unstale":"2024-09-14T22:46:02.058575+0000","last_undegraded":"2024-09-14T22:46:02.058575+0000","last_fullsized":"2024-09-14T22:46:02.058575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"1924'2","last_scrub_stamp":"2024-09-14T22:46:02.058425+0000","last_deep_scrub":"1924'2","last_deep_scrub_stamp":"2024-09-14T22:46:02.058425+0000","last_clean_scrub_stamp":"2024-09-14T22:46:02.058425+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:26:56.064176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00091213399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"1924'54","reported_seq":3957,"reported_epoch":1924,"state":"active+clean","last_fresh":"2024-09-14T22:46:01.031829+0000","last_change":"2024-09-14T22:46:01.031829+0000","last_active":"2024-09-14T22:46:01.031829+0000","last_peered":"2024-09-14T22:46:01.031829+0000","last_clean":"2024-09-14T22:46:01.031829+0000","last_became_active":"2024-09-14T21:22:40.256757+0000","last_became_peered":"2024-09-14T21:22:40.256757+0000","last_unstale":"2024-09-14T22:46:01.031829+0000","last_undegraded":"2024-09-14T22:46:01.031829+0000","last_fullsized":"2024-09-14T22:46:01.031829+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"1924'54","last_scrub_stamp":"2024-09-14T22:46:01.031751+0000","last_deep_scrub":"1924'54","last_deep_scrub_stamp":"2024-09-14T22:46:01.031751+0000","last_clean_scrub_stamp":"2024-09-14T22:46:01.031751+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:21:44.535703+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739376,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1172740,"kb_used_data":4532,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93199100,"statfs":{"total":96636764160,"available":95435878400,"internally_reserved":0,"allocated":4640768,"data_stored":2492700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359739376,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1173324,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1168190,"kb_avail":93198516,"statfs":{"total":96636764160,"available":95435280384,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1196227013},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359739376,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1367692,"kb_used_data":5116,"kb_used_omap":1,"kb_used_meta":1362558,"kb_avail":93004148,"statfs":{"total":96636764160,"available":95236247552,"internally_reserved":0,"allocated":5238784,"data_stored":3083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1395259851},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T22:46:21.449 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster cluster1 config set global mon_health_to_clog false 2024-09-14T22:46:21.827 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T22:46:21.827 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T22:46:21.827 DEBUG:tasks.ceph.cluster1.osd.0:waiting for process to exit 2024-09-14T22:46:21.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:46:26.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~0s 2024-09-14T22:46:27.930 INFO:tasks.ceph.cluster1.osd.0:Stopped 2024-09-14T22:46:27.930 DEBUG:tasks.ceph.cluster1.osd.1:waiting for process to exit 2024-09-14T22:46:27.930 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:46:32.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~0s 2024-09-14T22:46:32.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 has been restored 2024-09-14T22:46:34.033 INFO:tasks.ceph.cluster1.osd.1:Stopped 2024-09-14T22:46:34.033 DEBUG:tasks.ceph.cluster1.osd.2:waiting for process to exit 2024-09-14T22:46:34.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:46:37.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.2 is failed for ~0s 2024-09-14T22:46:37.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 has been restored 2024-09-14T22:46:40.135 INFO:tasks.ceph.cluster1.osd.2:Stopped 2024-09-14T22:46:40.135 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T22:46:40.136 DEBUG:tasks.ceph.cluster1.mgr.x:waiting for process to exit 2024-09-14T22:46:40.136 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:46:40.214 INFO:tasks.ceph.cluster1.mgr.x:Stopped 2024-09-14T22:46:40.215 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T22:46:40.215 DEBUG:tasks.ceph.cluster1.mon.a:waiting for process to exit 2024-09-14T22:46:40.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T22:46:40.249 INFO:tasks.ceph.cluster1.mon.a:Stopped 2024-09-14T22:46:40.250 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T22:46:40.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cluster1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-14T22:46:40.398 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T22:46:40.398 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-0 2024-09-14T22:46:40.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T22:46:40.780 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-1 2024-09-14T22:46:41.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T22:46:41.024 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-2 2024-09-14T22:46:41.269 INFO:tasks.ceph:Archiving mon data... 2024-09-14T22:46:41.269 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/cluster1-a to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/data/cluster1.mon.a.tgz 2024-09-14T22:46:41.269 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-14T22:46:41.312 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.NDmdLTmTnS 2024-09-14T22:46:41.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/cluster1-a -- . > /tmp/tmp.NDmdLTmTnS 2024-09-14T22:46:41.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.NDmdLTmTnS 2024-09-14T22:46:41.631 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.NDmdLTmTnS is 540KB 2024-09-14T22:46:41.722 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.NDmdLTmTnS 2024-09-14T22:46:41.757 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T22:46:41.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/cluster1.conf /etc/ceph/cluster1.keyring /home/ubuntu/cephtest/cluster1.data /home/ubuntu/cephtest/cluster1.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T22:46:41.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/cluster1.conf /etc/ceph/cluster1.keyring /home/ubuntu/cephtest/cluster1.data /home/ubuntu/cephtest/cluster1.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T22:46:41.900 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T22:46:42.019 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T22:46:42.019 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T22:46:42.022 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi063/crash 2024-09-14T22:46:42.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T22:46:42.077 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi169/crash 2024-09-14T22:46:42.078 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T22:46:42.135 INFO:tasks.ceph:Compressing logs... 2024-09-14T22:46:42.135 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T22:46:42.139 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T22:46:42.197 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33653.log 2024-09-14T22:46:42.197 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33446.log 2024-09-14T22:46:42.198 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33653.log.gz 2024-09-14T22:46:42.198 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33866.log 2024-09-14T22:46:42.199 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33446.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.28755.log 2024-09-14T22:46:42.199 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33446.log.gz 2024-09-14T22:46:42.200 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33866.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33866.log.gz 2024-09-14T22:46:42.200 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33370.log 2024-09-14T22:46:42.200 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.28755.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34034.log 2024-09-14T22:46:42.200 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.28755.log.gz 2024-09-14T22:46:42.201 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33370.log.gz 2024-09-14T22:46:42.201 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-mon.a.log 2024-09-14T22:46:42.202 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.34034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34034.log.gz 2024-09-14T22:46:42.202 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37842.log 2024-09-14T22:46:42.202 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-mon.a.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.29160.log 2024-09-14T22:46:42.203 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37842.log.gz 2024-09-14T22:46:42.203 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-osd.1.log 2024-09-14T22:46:42.204 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.29160.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.29160.log.gz -5 2024-09-14T22:46:42.204 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.33530.log 2024-09-14T22:46:42.205 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33395.log 2024-09-14T22:46:42.206 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33530.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33530.log.gz 2024-09-14T22:46:42.206 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37674.log 2024-09-14T22:46:42.206 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33395.log.gz 2024-09-14T22:46:42.206 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33652.log 2024-09-14T22:46:42.207 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37674.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37674.log.gz 2024-09-14T22:46:42.207 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37800.log 2024-09-14T22:46:42.208 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33652.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33652.log.gz 2024-09-14T22:46:42.208 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.29092.log 2024-09-14T22:46:42.209 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37800.log: gzip -5 --verbose -- /var/log/ceph/cluster1-osd.2.log 2024-09-14T22:46:42.209 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37800.log.gz 2024-09-14T22:46:42.209 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.29092.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.29092.log.gz 2024-09-14T22:46:42.210 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33906.log 2024-09-14T22:46:42.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.2 has been restored 2024-09-14T22:46:42.210 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37716.log 2024-09-14T22:46:42.211 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33906.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33906.log.gz 2024-09-14T22:46:42.211 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37548.log 2024-09-14T22:46:42.212 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37716.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37716.log.gz 2024-09-14T22:46:42.212 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33740.log 2024-09-14T22:46:42.213 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37548.log.gz 2024-09-14T22:46:42.213 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33488.log 2024-09-14T22:46:42.213 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33740.log.gz 2024-09-14T22:46:42.214 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.28953.log 2024-09-14T22:46:42.214 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/cluster1-mgr.x.log 2024-09-14T22:46:42.214 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33488.log.gz 2024-09-14T22:46:42.215 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.28953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.28953.log.gz 2024-09-14T22:46:42.215 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.38008.log 2024-09-14T22:46:42.216 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33992.log 2024-09-14T22:46:42.216 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.38008.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.38008.log.gz 2024-09-14T22:46:42.217 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.28913.log 2024-09-14T22:46:42.217 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33992.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33314.log 2024-09-14T22:46:42.218 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33992.log.gz 2024-09-14T22:46:42.218 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.28913.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.28913.log.gz 2024-09-14T22:46:42.218 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37926.log 2024-09-14T22:46:42.219 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33314.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37884.log 2024-09-14T22:46:42.219 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33314.log.gz 2024-09-14T22:46:42.220 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37926.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37926.log.gz 2024-09-14T22:46:42.220 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33779.log 2024-09-14T22:46:42.220 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37884.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.37884.log.gz 2024-09-14T22:46:42.221 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.37758.log 2024-09-14T22:46:42.221 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33779.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33779.log.gz 2024-09-14T22:46:42.221 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1.audit.log 2024-09-14T22:46:42.222 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37758.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37758.log.gz 2024-09-14T22:46:42.222 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37968.log 2024-09-14T22:46:42.223 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1.audit.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37506.log 2024-09-14T22:46:42.224 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37968.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37968.log.gz 2024-09-14T22:46:42.224 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-osd.0.log 2024-09-14T22:46:42.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141374.log 2024-09-14T22:46:42.225 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37506.log.gz 2024-09-14T22:46:42.225 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33780.log 2024-09-14T22:46:42.226 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-osd.0.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37632.log 2024-09-14T22:46:42.226 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137679.log 2024-09-14T22:46:42.226 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141374.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141374.log.gz 2024-09-14T22:46:42.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91370.log 2024-09-14T22:46:42.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137679.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137679.log.gz 2024-09-14T22:46:42.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137990.log 2024-09-14T22:46:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33780.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33780.log.gz 2024-09-14T22:46:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33905.log 2024-09-14T22:46:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37632.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37632.log.gz 2024-09-14T22:46:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.37590.log 2024-09-14T22:46:42.233 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33905.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33654.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.37590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.37590.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.33572.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33654.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.33654.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.28993.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.33572.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.admin.33572.log.gz --verbose 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph.tmp-client.admin.24463.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.28993.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.28993.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.24463.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24463.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.31720.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34076.log 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.31720.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.31720.log.gz 2024-09-14T22:46:42.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91370.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98684.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137990.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137990.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148982.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98684.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98684.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145244.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148982.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38376.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145244.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145244.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86361.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38376.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38376.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79676.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86361.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86361.log.gz 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43220.log 2024-09-14T22:46:42.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79676.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79676.log.gz 2024-09-14T22:46:42.236 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149588.log 2024-09-14T22:46:42.236 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cluster1-client.admin.34076.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34076.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43220.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108755.log 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149588.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149588.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52003.log 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108755.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108755.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97528.log 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52003.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52003.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54085.log 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97528.log.gz 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50327.log 2024-09-14T22:46:42.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54085.log.gz 2024-09-14T22:46:42.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144084.log 2024-09-14T22:46:42.240 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50327.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50327.log.gz 2024-09-14T22:46:42.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91353.log 2024-09-14T22:46:42.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144084.log.gz 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79456.log 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91353.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91353.log.gz 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86341.log 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79456.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79456.log.gz 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150739.log 2024-09-14T22:46:42.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86341.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86341.log.gz 2024-09-14T22:46:42.243 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/cluster1.log.gz 2024-09-14T22:46:42.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145934.log 2024-09-14T22:46:42.249 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150739.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150739.log.gz 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106908.log 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145934.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145934.log.gz 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124211.log 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106908.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106908.log.gz 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41386.log 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124211.log.gz 2024-09-14T22:46:42.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100192.log 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41386.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41386.log.gz 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39304.log 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100192.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100192.log.gz 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.33934.log 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39304.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39304.log.gz 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147931.log 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.33934.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.33934.log.gz 2024-09-14T22:46:42.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124227.log 2024-09-14T22:46:42.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147931.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147931.log.gz 2024-09-14T22:46:42.252 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47632.log 2024-09-14T22:46:42.253 INFO:teuthology.orchestra.run.smithi063.stderr: 92.3% -- replaced with /var/log/ceph/cluster1.audit.log.gz 2024-09-14T22:46:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124227.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124227.log.gz 2024-09-14T22:46:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53373.log 2024-09-14T22:46:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47632.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47632.log.gz 2024-09-14T22:46:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53035.log 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53373.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53373.log.gz 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64947.log 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53035.log.gz 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89616.log 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64947.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64947.log.gz 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87349.log 2024-09-14T22:46:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89616.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89616.log.gz 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132332.log 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87349.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87349.log.gz 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41275.log 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132332.log.gz 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153573.log 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41275.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41275.log.gz 2024-09-14T22:46:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58978.log 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153573.log.gz 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147066.log 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58978.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58978.log.gz 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103048.log 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147066.log.gz 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129522.log 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103048.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103048.log.gz 2024-09-14T22:46:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144509.log 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129522.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129522.log.gz 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78674.log 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144509.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144509.log.gz 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60855.log 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78674.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78674.log.gz 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67607.log 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60855.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60855.log.gz 2024-09-14T22:46:42.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122298.log 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67607.log.gz 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109151.log 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122298.log.gz 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143221.log 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109151.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109151.log.gz 2024-09-14T22:46:42.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76160.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143221.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90246.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76160.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76160.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63038.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90246.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90246.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83939.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63038.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152576.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83939.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83939.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73175.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152576.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111650.log 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73175.log.gz 2024-09-14T22:46:42.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68138.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111650.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111650.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139439.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68138.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68138.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62162.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139439.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48575.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62162.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62162.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78380.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48575.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42221.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78380.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78380.log.gz 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49340.log 2024-09-14T22:46:42.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42221.log.gz 2024-09-14T22:46:42.280 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90458.log 2024-09-14T22:46:42.282 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49340.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49340.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145451.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90458.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121309.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145451.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145451.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76223.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121309.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121309.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151255.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76223.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76223.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59133.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151255.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151255.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116222.log 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59133.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59133.log.gz 2024-09-14T22:46:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112954.log 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116222.log.gz 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118793.log 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112954.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112954.log.gz 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102148.log 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118793.log.gz 2024-09-14T22:46:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53458.log 2024-09-14T22:46:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102148.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102148.log.gz 2024-09-14T22:46:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110306.log 2024-09-14T22:46:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53458.log.gz 2024-09-14T22:46:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86707.log 2024-09-14T22:46:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110306.log.gz 2024-09-14T22:46:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72407.log 2024-09-14T22:46:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86707.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86707.log.gz 2024-09-14T22:46:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142937.log 2024-09-14T22:46:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72407.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72407.log.gz 2024-09-14T22:46:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50056.log 2024-09-14T22:46:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142937.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142937.log.gz 2024-09-14T22:46:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115353.log 2024-09-14T22:46:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50056.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50056.log.gz 2024-09-14T22:46:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116354.log 2024-09-14T22:46:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115353.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115353.log.gz 2024-09-14T22:46:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87307.log 2024-09-14T22:46:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116354.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116354.log.gz 2024-09-14T22:46:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100027.log 2024-09-14T22:46:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87307.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87307.log.gz 2024-09-14T22:46:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46819.log 2024-09-14T22:46:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100027.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100027.log.gz 2024-09-14T22:46:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69557.log 2024-09-14T22:46:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46819.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46819.log.gz 2024-09-14T22:46:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74223.log 2024-09-14T22:46:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69557.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.admin.69557.log.gz --verbose 2024-09-14T22:46:42.296 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.64170.log 2024-09-14T22:46:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74223.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74223.log.gz 2024-09-14T22:46:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135153.log 2024-09-14T22:46:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64170.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64170.log.gz 2024-09-14T22:46:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114793.log 2024-09-14T22:46:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135153.log.gzgzip 2024-09-14T22:46:42.298 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96209.log 2024-09-14T22:46:42.299 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114793.log.gz 2024-09-14T22:46:42.299 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97360.log 2024-09-14T22:46:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96209.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96209.log.gz -5 --verbose 2024-09-14T22:46:42.300 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.admin.56348.log 2024-09-14T22:46:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97360.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97360.log.gz 2024-09-14T22:46:42.300 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88607.log 2024-09-14T22:46:42.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56348.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56348.log.gz -5 2024-09-14T22:46:42.301 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.64948.log 2024-09-14T22:46:42.302 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88607.log.gz 2024-09-14T22:46:42.302 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70320.log 2024-09-14T22:46:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64948.log.gz 2024-09-14T22:46:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76643.log 2024-09-14T22:46:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70320.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70320.log.gz 2024-09-14T22:46:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43194.log 2024-09-14T22:46:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76643.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76643.log.gz 2024-09-14T22:46:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116968.log 2024-09-14T22:46:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43194.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43194.log.gz 2024-09-14T22:46:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59720.log 2024-09-14T22:46:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116968.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.71057.log 0.0% 2024-09-14T22:46:42.307 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.116968.log.gz 2024-09-14T22:46:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59720.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59720.log.gz -5 2024-09-14T22:46:42.307 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.142673.log 2024-09-14T22:46:42.308 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.71057.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.71057.log.gz 2024-09-14T22:46:42.308 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99815.log 2024-09-14T22:46:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142673.log.gz 2024-09-14T22:46:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62196.log 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99815.log.gz 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37579.log 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62196.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.62196.log.gz 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.61816.log 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37579.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37579.log.gz 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41318.log 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61816.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61816.log.gz 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135984.log 2024-09-14T22:46:42.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41318.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41318.log.gz 2024-09-14T22:46:42.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62909.log 2024-09-14T22:46:42.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135984.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135984.log.gz 2024-09-14T22:46:42.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127327.log 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62909.log.gz 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87242.log 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127327.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127327.log.gz 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79765.log 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87242.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87242.log.gz 2024-09-14T22:46:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41045.log 2024-09-14T22:46:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79765.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79765.log.gz 2024-09-14T22:46:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105861.log 2024-09-14T22:46:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41045.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41045.log.gz 2024-09-14T22:46:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50663.log 2024-09-14T22:46:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105861.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105861.log.gz 2024-09-14T22:46:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120641.log 2024-09-14T22:46:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50663.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50663.log.gz 2024-09-14T22:46:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154575.log 2024-09-14T22:46:42.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120641.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120641.log.gz 2024-09-14T22:46:42.320 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104904.log 2024-09-14T22:46:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154575.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154575.log.gz 2024-09-14T22:46:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40416.log 2024-09-14T22:46:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104904.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104904.log.gz 2024-09-14T22:46:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71728.log 2024-09-14T22:46:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40416.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40416.log.gz 2024-09-14T22:46:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55422.log 2024-09-14T22:46:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71728.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71728.log.gz 2024-09-14T22:46:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125368.log 2024-09-14T22:46:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55422.log.gz 2024-09-14T22:46:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69556.log 2024-09-14T22:46:42.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125368.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82456.log 2024-09-14T22:46:42.325 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125368.log.gz 2024-09-14T22:46:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69556.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69556.log.gz 2024-09-14T22:46:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113167.log 2024-09-14T22:46:42.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82456.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82456.log.gz 2024-09-14T22:46:42.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103947.log 2024-09-14T22:46:42.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113167.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113167.log.gz 2024-09-14T22:46:42.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52155.log 2024-09-14T22:46:42.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103947.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103947.log.gz 2024-09-14T22:46:42.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122821.log 2024-09-14T22:46:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52155.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52155.log.gz 2024-09-14T22:46:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66810.log 2024-09-14T22:46:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122821.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122821.log.gz 2024-09-14T22:46:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141335.log 2024-09-14T22:46:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66810.log.gz 2024-09-14T22:46:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64673.log 2024-09-14T22:46:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141335.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141335.log.gz 2024-09-14T22:46:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128003.log 2024-09-14T22:46:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64673.log.gz 2024-09-14T22:46:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102933.log 2024-09-14T22:46:42.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128003.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128003.log.gz 2024-09-14T22:46:42.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113921.log 2024-09-14T22:46:42.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102933.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102933.log.gz -5 2024-09-14T22:46:42.334 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.97527.log 2024-09-14T22:46:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113921.log.gz 2024-09-14T22:46:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152960.log 2024-09-14T22:46:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97527.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97527.log.gz 2024-09-14T22:46:42.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57660.log 2024-09-14T22:46:42.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152960.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152960.log.gz 2024-09-14T22:46:42.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102443.log 2024-09-14T22:46:42.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57660.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57660.log.gz 2024-09-14T22:46:42.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57894.log 2024-09-14T22:46:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102443.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102443.log.gz 2024-09-14T22:46:42.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121939.log 2024-09-14T22:46:42.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57894.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57894.log.gz 2024-09-14T22:46:42.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121688.log 2024-09-14T22:46:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121939.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129762.log 2024-09-14T22:46:42.340 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121939.log.gz 2024-09-14T22:46:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121688.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121688.log.gz 2024-09-14T22:46:42.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152883.log 2024-09-14T22:46:42.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129762.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129762.log.gz 2024-09-14T22:46:42.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53120.log 2024-09-14T22:46:42.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152883.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152883.log.gz 2024-09-14T22:46:42.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113454.log 2024-09-14T22:46:42.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53120.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53120.log.gz 2024-09-14T22:46:42.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136207.log 2024-09-14T22:46:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113454.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113454.log.gz 2024-09-14T22:46:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88318.log 2024-09-14T22:46:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136207.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136207.log.gz 2024-09-14T22:46:42.344 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68704.log 2024-09-14T22:46:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88318.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88318.log.gz 2024-09-14T22:46:42.345 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96035.log 2024-09-14T22:46:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68704.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68704.log.gz 2024-09-14T22:46:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90602.log 2024-09-14T22:46:42.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96035.log.gz 2024-09-14T22:46:42.347 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66523.log 2024-09-14T22:46:42.348 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90602.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90602.log.gz 2024-09-14T22:46:42.348 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37009.log 2024-09-14T22:46:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66523.log.gz 2024-09-14T22:46:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90081.log 2024-09-14T22:46:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37009.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37009.log.gz 2024-09-14T22:46:42.349 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84093.log 2024-09-14T22:46:42.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90081.log.gz 2024-09-14T22:46:42.350 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82410.log 2024-09-14T22:46:42.351 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84093.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84093.log.gz 2024-09-14T22:46:42.351 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100611.log 2024-09-14T22:46:42.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82410.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82410.log.gz 2024-09-14T22:46:42.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77818.log 2024-09-14T22:46:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100611.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100611.log.gz 2024-09-14T22:46:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99294.log 2024-09-14T22:46:42.353 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77818.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77818.log.gz 2024-09-14T22:46:42.353 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119471.log 2024-09-14T22:46:42.354 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99294.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99294.log.gz 2024-09-14T22:46:42.354 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38375.log 2024-09-14T22:46:42.355 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119471.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119471.log.gz 2024-09-14T22:46:42.355 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148768.log 2024-09-14T22:46:42.356 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38375.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38375.log.gz 2024-09-14T22:46:42.356 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41906.log 2024-09-14T22:46:42.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148768.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148768.log.gz 2024-09-14T22:46:42.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116096.log 2024-09-14T22:46:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41906.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41906.log.gz 2024-09-14T22:46:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51903.log 2024-09-14T22:46:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116096.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116096.log.gz 2024-09-14T22:46:42.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145322.log 2024-09-14T22:46:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51903.log.gz 2024-09-14T22:46:42.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99694.log 2024-09-14T22:46:42.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145322.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145322.log.gz 2024-09-14T22:46:42.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114008.log 2024-09-14T22:46:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99694.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99694.log.gz 2024-09-14T22:46:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142050.log 2024-09-14T22:46:42.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114008.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114008.log.gz 2024-09-14T22:46:42.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66730.log 2024-09-14T22:46:42.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142050.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142050.log.gz 2024-09-14T22:46:42.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55420.log 2024-09-14T22:46:42.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66730.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66730.log.gz 2024-09-14T22:46:42.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65421.log 2024-09-14T22:46:42.364 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55420.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55420.log.gz 2024-09-14T22:46:42.364 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136037.log 2024-09-14T22:46:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65421.log.gz 2024-09-14T22:46:42.365 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144721.log 2024-09-14T22:46:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136037.log.gz 2024-09-14T22:46:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71775.log 2024-09-14T22:46:42.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144721.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144721.log.gz 2024-09-14T22:46:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153140.log 2024-09-14T22:46:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71775.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71775.log.gz 2024-09-14T22:46:42.367 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107587.log 2024-09-14T22:46:42.368 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153140.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153140.log.gz 2024-09-14T22:46:42.368 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107301.log 2024-09-14T22:46:42.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107587.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107587.log.gz 2024-09-14T22:46:42.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46591.log 2024-09-14T22:46:42.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107301.log.gz 2024-09-14T22:46:42.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.129628.log 2024-09-14T22:46:42.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46591.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122303.log 2024-09-14T22:46:42.371 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46591.log.gz 2024-09-14T22:46:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.129628.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.129628.log.gz 2024-09-14T22:46:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132543.log 2024-09-14T22:46:42.372 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122303.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122303.log.gz 2024-09-14T22:46:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150065.log 2024-09-14T22:46:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132543.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132543.log.gz 2024-09-14T22:46:42.373 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136289.log 2024-09-14T22:46:42.374 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150065.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150065.log.gz 2024-09-14T22:46:42.374 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51818.log 2024-09-14T22:46:42.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136289.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136289.log.gz 2024-09-14T22:46:42.375 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91902.log 2024-09-14T22:46:42.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51818.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51818.log.gz 2024-09-14T22:46:42.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.127958.log 2024-09-14T22:46:42.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91902.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91902.log.gz 2024-09-14T22:46:42.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59810.log 2024-09-14T22:46:42.377 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.127958.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140600.log 2024-09-14T22:46:42.377 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.127958.log.gz 2024-09-14T22:46:42.378 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59810.log.gz 2024-09-14T22:46:42.378 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111651.log 2024-09-14T22:46:42.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140600.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140600.log.gz 2024-09-14T22:46:42.379 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68041.log 2024-09-14T22:46:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111651.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111651.log.gz 2024-09-14T22:46:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120033.log 2024-09-14T22:46:42.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68041.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68041.log.gz 2024-09-14T22:46:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53289.log 2024-09-14T22:46:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120033.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120033.log.gz 2024-09-14T22:46:42.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82114.log 2024-09-14T22:46:42.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53289.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53289.log.gz 2024-09-14T22:46:42.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65311.log 2024-09-14T22:46:42.383 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82114.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82114.log.gz 2024-09-14T22:46:42.383 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95989.log 2024-09-14T22:46:42.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65311.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65311.log.gz 2024-09-14T22:46:42.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67919.log 2024-09-14T22:46:42.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95989.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94348.log 2024-09-14T22:46:42.384 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95989.log.gz 2024-09-14T22:46:42.385 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67919.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67919.log.gz 2024-09-14T22:46:42.385 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109361.log 2024-09-14T22:46:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94348.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94348.log.gz 2024-09-14T22:46:42.386 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70829.log 2024-09-14T22:46:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109361.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109361.log.gz 2024-09-14T22:46:42.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129483.log 2024-09-14T22:46:42.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70829.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70829.log.gz 2024-09-14T22:46:42.388 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56275.log 2024-09-14T22:46:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129483.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129483.log.gz 2024-09-14T22:46:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139501.log 2024-09-14T22:46:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56275.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56275.log.gz 2024-09-14T22:46:42.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62826.log 2024-09-14T22:46:42.390 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139501.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139501.log.gz 2024-09-14T22:46:42.390 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87809.log 2024-09-14T22:46:42.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62826.log.gz 2024-09-14T22:46:42.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35685.log 2024-09-14T22:46:42.392 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87809.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87809.log.gz 2024-09-14T22:46:42.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149380.log 2024-09-14T22:46:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35685.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35685.log.gz 2024-09-14T22:46:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127434.log 2024-09-14T22:46:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149380.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149380.log.gz 2024-09-14T22:46:42.393 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136460.log 2024-09-14T22:46:42.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127434.log.gz 2024-09-14T22:46:42.394 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99886.log 2024-09-14T22:46:42.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136460.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136460.log.gz 2024-09-14T22:46:42.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117556.log 2024-09-14T22:46:42.396 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99886.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99886.log.gz 2024-09-14T22:46:42.396 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82839.log 2024-09-14T22:46:42.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117556.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117556.log.gz 2024-09-14T22:46:42.397 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88397.log 2024-09-14T22:46:42.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82839.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82839.log.gz 2024-09-14T22:46:42.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147938.log 2024-09-14T22:46:42.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88397.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88397.log.gz 2024-09-14T22:46:42.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153660.log 2024-09-14T22:46:42.399 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147938.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147938.log.gz 2024-09-14T22:46:42.399 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60686.log 2024-09-14T22:46:42.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153660.log.gz 2024-09-14T22:46:42.400 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150314.log 2024-09-14T22:46:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60686.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60686.log.gz 2024-09-14T22:46:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100280.log 2024-09-14T22:46:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150314.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150314.log.gz 2024-09-14T22:46:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122951.log 2024-09-14T22:46:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100280.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100280.log.gz 2024-09-14T22:46:42.402 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42465.log 2024-09-14T22:46:42.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122951.log.gz 2024-09-14T22:46:42.403 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116782.log 2024-09-14T22:46:42.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42465.log.gz 2024-09-14T22:46:42.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130560.log 2024-09-14T22:46:42.405 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116782.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116782.log.gz 2024-09-14T22:46:42.405 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138013.log 2024-09-14T22:46:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130560.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130560.log.gz 2024-09-14T22:46:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93109.log 2024-09-14T22:46:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138013.log.gz 2024-09-14T22:46:42.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63222.log 2024-09-14T22:46:42.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93109.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93109.log.gz 2024-09-14T22:46:42.407 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112614.log 2024-09-14T22:46:42.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63222.log.gz 2024-09-14T22:46:42.408 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106545.log 2024-09-14T22:46:42.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112614.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112614.log.gz 2024-09-14T22:46:42.409 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132919.log 2024-09-14T22:46:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106545.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106545.log.gz 2024-09-14T22:46:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106244.log 2024-09-14T22:46:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132919.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132919.log.gz 2024-09-14T22:46:42.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59659.log 2024-09-14T22:46:42.411 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106244.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106244.log.gz 2024-09-14T22:46:42.411 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110330.log 2024-09-14T22:46:42.412 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59659.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59659.log.gz 2024-09-14T22:46:42.412 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102045.log 2024-09-14T22:46:42.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110330.log.gz 2024-09-14T22:46:42.413 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81001.log 2024-09-14T22:46:42.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102045.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145411.log 2024-09-14T22:46:42.414 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102045.log.gz 2024-09-14T22:46:42.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81001.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81001.log.gz 2024-09-14T22:46:42.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117726.log 2024-09-14T22:46:42.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145411.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145411.log.gz 2024-09-14T22:46:42.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46538.log 2024-09-14T22:46:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117726.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117726.log.gz 2024-09-14T22:46:42.416 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64881.log 2024-09-14T22:46:42.417 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46538.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46538.log.gz 2024-09-14T22:46:42.417 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92310.log 2024-09-14T22:46:42.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64881.log.gz 2024-09-14T22:46:42.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86026.log 2024-09-14T22:46:42.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92310.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92310.log.gz 2024-09-14T22:46:42.419 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152811.log 2024-09-14T22:46:42.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86026.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86026.log.gz 2024-09-14T22:46:42.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76914.log 2024-09-14T22:46:42.420 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152811.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152811.log.gz 2024-09-14T22:46:42.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103506.log 2024-09-14T22:46:42.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76914.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76914.log.gz 2024-09-14T22:46:42.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85541.log 2024-09-14T22:46:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103506.log.gz 2024-09-14T22:46:42.422 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133590.log 2024-09-14T22:46:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85541.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.85541.log.gz -- 2024-09-14T22:46:42.423 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.115793.log 2024-09-14T22:46:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133590.log.gz 2024-09-14T22:46:42.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89994.log 2024-09-14T22:46:42.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115793.log.gz 2024-09-14T22:46:42.424 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.127906.log 2024-09-14T22:46:42.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89994.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89994.log.gz 2024-09-14T22:46:42.425 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133191.log 2024-09-14T22:46:42.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.127906.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.127906.log.gz 2024-09-14T22:46:42.426 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101310.log 2024-09-14T22:46:42.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133191.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133191.log.gz 2024-09-14T22:46:42.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113963.log 2024-09-14T22:46:42.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101310.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101310.log.gz 2024-09-14T22:46:42.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57533.log 2024-09-14T22:46:42.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113963.log.gz 2024-09-14T22:46:42.428 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137843.log 2024-09-14T22:46:42.429 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57533.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57533.log.gz 2024-09-14T22:46:42.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60508.log 2024-09-14T22:46:42.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137843.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137843.log.gz 2024-09-14T22:46:42.430 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134842.log 2024-09-14T22:46:42.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60508.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60508.log.gz 2024-09-14T22:46:42.431 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41046.log 2024-09-14T22:46:42.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134842.log.gz 2024-09-14T22:46:42.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102565.log 2024-09-14T22:46:42.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41046.log.gz 2024-09-14T22:46:42.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80192.log 2024-09-14T22:46:42.433 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102565.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102565.log.gz 2024-09-14T22:46:42.433 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148831.log 2024-09-14T22:46:42.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80192.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80192.log.gz 2024-09-14T22:46:42.434 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91880.log 2024-09-14T22:46:42.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148831.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148831.log.gz 2024-09-14T22:46:42.435 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.127907.log 2024-09-14T22:46:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91880.log.gz 2024-09-14T22:46:42.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115529.log 2024-09-14T22:46:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.127907.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.127907.log.gz 2024-09-14T22:46:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93807.log 2024-09-14T22:46:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115529.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115529.log.gz 2024-09-14T22:46:42.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100467.log 2024-09-14T22:46:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93807.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93807.log.gz 2024-09-14T22:46:42.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58335.log 2024-09-14T22:46:42.439 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100467.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100467.log.gz 2024-09-14T22:46:42.439 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62287.log 2024-09-14T22:46:42.439 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58335.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58335.log.gz 2024-09-14T22:46:42.439 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138845.log 2024-09-14T22:46:42.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62287.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62287.log.gz 2024-09-14T22:46:42.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149505.log 2024-09-14T22:46:42.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138845.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138845.log.gz 2024-09-14T22:46:42.441 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100783.log 2024-09-14T22:46:42.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149505.log.gz 2024-09-14T22:46:42.442 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92371.log 2024-09-14T22:46:42.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100783.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100783.log.gz 2024-09-14T22:46:42.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49677.log 2024-09-14T22:46:42.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92371.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92371.log.gz 2024-09-14T22:46:42.444 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131830.log 2024-09-14T22:46:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49677.log.gz 2024-09-14T22:46:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85457.log 2024-09-14T22:46:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131830.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131830.log.gz 2024-09-14T22:46:42.445 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106297.log 2024-09-14T22:46:42.446 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85457.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85457.log.gz 2024-09-14T22:46:42.446 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49949.log 2024-09-14T22:46:42.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106297.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106297.log.gz 2024-09-14T22:46:42.447 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63308.log 2024-09-14T22:46:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49949.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49949.log.gz 2024-09-14T22:46:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86192.log 2024-09-14T22:46:42.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63308.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63308.log.gz 2024-09-14T22:46:42.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146415.log 2024-09-14T22:46:42.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86192.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86192.log.gz 2024-09-14T22:46:42.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148518.log 2024-09-14T22:46:42.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146415.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146415.log.gz 2024-09-14T22:46:42.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150431.log 2024-09-14T22:46:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148518.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148518.log.gz 2024-09-14T22:46:42.451 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82892.log 2024-09-14T22:46:42.452 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150431.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150431.log.gz 2024-09-14T22:46:42.452 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34573.log 2024-09-14T22:46:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82892.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82892.log.gz 2024-09-14T22:46:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55652.log 2024-09-14T22:46:42.453 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34573.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34573.log.gz 2024-09-14T22:46:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73280.log 2024-09-14T22:46:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55652.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55652.log.gz 2024-09-14T22:46:42.454 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87057.log 2024-09-14T22:46:42.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73280.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73280.log.gz 2024-09-14T22:46:42.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122800.log 2024-09-14T22:46:42.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87057.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87057.log.gz 2024-09-14T22:46:42.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75903.log 2024-09-14T22:46:42.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122800.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122800.log.gz 2024-09-14T22:46:42.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72649.log 2024-09-14T22:46:42.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75903.log.gz 2024-09-14T22:46:42.458 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153713.log 2024-09-14T22:46:42.458 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72649.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93602.log 0.0% 2024-09-14T22:46:42.458 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.72649.log.gz 2024-09-14T22:46:42.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153713.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153713.log.gz 2024-09-14T22:46:42.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90929.log 2024-09-14T22:46:42.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93602.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93602.log.gz 2024-09-14T22:46:42.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134696.log 2024-09-14T22:46:42.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90929.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90929.log.gz 2024-09-14T22:46:42.461 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86637.log 2024-09-14T22:46:42.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134696.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134696.log.gz 2024-09-14T22:46:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104207.log 2024-09-14T22:46:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86637.log.gz 2024-09-14T22:46:42.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114300.log 2024-09-14T22:46:42.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104207.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104207.log.gz 2024-09-14T22:46:42.463 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97173.log 2024-09-14T22:46:42.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114300.log.gz 2024-09-14T22:46:42.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.57156.log 2024-09-14T22:46:42.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97173.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97173.log.gz 2024-09-14T22:46:42.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97276.log 2024-09-14T22:46:42.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.57156.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.57156.log.gz 2024-09-14T22:46:42.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151410.log 2024-09-14T22:46:42.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97276.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97276.log.gz 2024-09-14T22:46:42.467 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120640.log 2024-09-14T22:46:42.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151410.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151410.log.gz 2024-09-14T22:46:42.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119878.log 2024-09-14T22:46:42.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120640.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120640.log.gz 2024-09-14T22:46:42.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83677.log 2024-09-14T22:46:42.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119878.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.119878.log.gz /var/log/ceph/cluster1-client.mirror.88019.log 2024-09-14T22:46:42.469 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83677.log.gz 2024-09-14T22:46:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98975.log 2024-09-14T22:46:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88019.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88019.log.gz 2024-09-14T22:46:42.471 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126545.log 2024-09-14T22:46:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98975.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98975.log.gz 2024-09-14T22:46:42.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130426.log 2024-09-14T22:46:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126545.log.gz 2024-09-14T22:46:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64359.log 2024-09-14T22:46:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130426.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130426.log.gz 2024-09-14T22:46:42.473 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38861.log 2024-09-14T22:46:42.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64359.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64359.log.gz 2024-09-14T22:46:42.474 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57384.log 2024-09-14T22:46:42.475 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38861.log.gz 2024-09-14T22:46:42.475 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64571.log 2024-09-14T22:46:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57384.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57384.log.gz 2024-09-14T22:46:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131393.log 2024-09-14T22:46:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64571.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.64571.log.gz --verbose 2024-09-14T22:46:42.476 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.146775.log 2024-09-14T22:46:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131393.log.gz 2024-09-14T22:46:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69887.log 2024-09-14T22:46:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146775.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146775.log.gz 2024-09-14T22:46:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72606.log 2024-09-14T22:46:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69887.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69887.log.gz 2024-09-14T22:46:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130084.log 2024-09-14T22:46:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72606.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72606.log.gz 2024-09-14T22:46:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114100.log 2024-09-14T22:46:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130084.log.gz 2024-09-14T22:46:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54922.log 2024-09-14T22:46:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114100.log.gz 2024-09-14T22:46:42.482 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93600.log 2024-09-14T22:46:42.482 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54922.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54922.log.gz 2024-09-14T22:46:42.482 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95160.log 2024-09-14T22:46:42.483 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93600.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93600.log.gz 2024-09-14T22:46:42.483 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96963.log 2024-09-14T22:46:42.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95160.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95160.log.gz 2024-09-14T22:46:42.484 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130915.log 2024-09-14T22:46:42.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96963.log.gz 2024-09-14T22:46:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137467.log 2024-09-14T22:46:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130915.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130915.log.gz 2024-09-14T22:46:42.485 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146482.log 2024-09-14T22:46:42.486 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137467.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137467.log.gz 2024-09-14T22:46:42.486 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62782.log 2024-09-14T22:46:42.487 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146482.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146482.log.gz 2024-09-14T22:46:42.487 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141667.log 2024-09-14T22:46:42.488 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62782.log.gz 2024-09-14T22:46:42.488 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82570.log 2024-09-14T22:46:42.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141667.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141667.log.gz 2024-09-14T22:46:42.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75861.log 2024-09-14T22:46:42.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82570.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82570.log.gz 2024-09-14T22:46:42.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61105.log 2024-09-14T22:46:42.490 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89995.log 2024-09-14T22:46:42.491 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75861.log.gz 2024-09-14T22:46:42.491 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61105.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61105.log.gz 2024-09-14T22:46:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88568.log 2024-09-14T22:46:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89995.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89995.log.gz 2024-09-14T22:46:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137256.log 2024-09-14T22:46:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88568.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88568.log.gz 2024-09-14T22:46:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125049.log 2024-09-14T22:46:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137256.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138518.log 2024-09-14T22:46:42.494 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137256.log.gz 2024-09-14T22:46:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125049.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125049.log.gz 2024-09-14T22:46:42.494 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143423.log 2024-09-14T22:46:42.495 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138518.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138518.log.gz 2024-09-14T22:46:42.495 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60854.log 2024-09-14T22:46:42.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143423.log.gz 2024-09-14T22:46:42.496 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105955.log 2024-09-14T22:46:42.497 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60854.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60854.log.gz 2024-09-14T22:46:42.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48797.log 2024-09-14T22:46:42.497 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105955.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151625.log 2024-09-14T22:46:42.497 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105955.log.gz 2024-09-14T22:46:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48797.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48797.log.gz 2024-09-14T22:46:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.132111.log 2024-09-14T22:46:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151625.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151625.log.gz 2024-09-14T22:46:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63394.log 2024-09-14T22:46:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.132111.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88820.log 2024-09-14T22:46:42.500 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.132111.log.gz 2024-09-14T22:46:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63394.log.gz 2024-09-14T22:46:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126726.log 2024-09-14T22:46:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88820.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88820.log.gz 2024-09-14T22:46:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130782.log 2024-09-14T22:46:42.502 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126726.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96140.log 2024-09-14T22:46:42.502 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126726.log.gz 2024-09-14T22:46:42.503 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130782.log.gz 2024-09-14T22:46:42.503 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134840.log 2024-09-14T22:46:42.504 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96140.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96140.log.gz 2024-09-14T22:46:42.504 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118384.log 2024-09-14T22:46:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134840.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134840.log.gz 2024-09-14T22:46:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119860.log 2024-09-14T22:46:42.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118384.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34319.log 2024-09-14T22:46:42.505 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118384.log.gz 2024-09-14T22:46:42.507 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119860.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119860.log.gz 2024-09-14T22:46:42.507 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137678.log 2024-09-14T22:46:42.507 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34319.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83830.log 2024-09-14T22:46:42.507 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34319.log.gz 2024-09-14T22:46:42.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137678.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137678.log.gz 2024-09-14T22:46:42.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64234.log 2024-09-14T22:46:42.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83830.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83830.log.gz 2024-09-14T22:46:42.509 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129929.log 2024-09-14T22:46:42.509 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64234.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63876.log 2024-09-14T22:46:42.509 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64234.log.gz 2024-09-14T22:46:42.510 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129929.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129929.log.gz 2024-09-14T22:46:42.511 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114659.log 2024-09-14T22:46:42.511 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63876.log.gz 2024-09-14T22:46:42.511 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44993.log 2024-09-14T22:46:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114659.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153868.log 2024-09-14T22:46:42.512 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114659.log.gz 2024-09-14T22:46:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44993.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44993.log.gz 2024-09-14T22:46:42.512 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58811.log 2024-09-14T22:46:42.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153868.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153868.log.gz 2024-09-14T22:46:42.513 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37262.log 2024-09-14T22:46:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58811.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58811.log.gz 2024-09-14T22:46:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52676.log 2024-09-14T22:46:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37262.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37262.log.gz 2024-09-14T22:46:42.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83876.log 2024-09-14T22:46:42.515 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52676.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67044.log 2024-09-14T22:46:42.515 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52676.log.gz 2024-09-14T22:46:42.516 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83876.log.gz 2024-09-14T22:46:42.516 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34917.log 2024-09-14T22:46:42.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67044.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67044.log.gz 2024-09-14T22:46:42.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83177.log 2024-09-14T22:46:42.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.34917.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34917.log.gz 2024-09-14T22:46:42.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41616.log 2024-09-14T22:46:42.518 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83177.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135468.log 2024-09-14T22:46:42.518 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83177.log.gz 2024-09-14T22:46:42.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41616.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41616.log.gz 2024-09-14T22:46:42.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105505.log 2024-09-14T22:46:42.520 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135468.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135468.log.gz 2024-09-14T22:46:42.520 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106659.log 2024-09-14T22:46:42.520 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105505.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151882.log 2024-09-14T22:46:42.520 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105505.log.gz 2024-09-14T22:46:42.521 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106659.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106659.log.gz 2024-09-14T22:46:42.521 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153100.log 2024-09-14T22:46:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151882.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151882.log.gzgzip 2024-09-14T22:46:42.522 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76282.log 2024-09-14T22:46:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153100.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60637.log 2024-09-14T22:46:42.523 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153100.log.gz 2024-09-14T22:46:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76282.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77207.log 2024-09-14T22:46:42.524 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76282.log.gz 2024-09-14T22:46:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60637.log.gz 2024-09-14T22:46:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82094.log 2024-09-14T22:46:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77207.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77207.log.gz 2024-09-14T22:46:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116224.log 2024-09-14T22:46:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82094.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39936.log 2024-09-14T22:46:42.526 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82094.log.gz 2024-09-14T22:46:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116224.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116224.log.gz 2024-09-14T22:46:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93131.log 2024-09-14T22:46:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39936.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39936.log.gz 2024-09-14T22:46:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.141594.log 2024-09-14T22:46:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93131.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93131.log.gz 2024-09-14T22:46:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142070.log 2024-09-14T22:46:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.141594.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.80724.log 2024-09-14T22:46:42.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.141594.log.gz 2024-09-14T22:46:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142070.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148016.log 2024-09-14T22:46:42.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142070.log.gz 2024-09-14T22:46:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.80724.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.80724.log.gz 2024-09-14T22:46:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51777.log 2024-09-14T22:46:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148016.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148016.log.gz 2024-09-14T22:46:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149087.log 2024-09-14T22:46:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51777.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150077.log 2024-09-14T22:46:42.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51777.log.gz 2024-09-14T22:46:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149087.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149087.log.gz 2024-09-14T22:46:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144172.log 2024-09-14T22:46:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150077.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150077.log.gz 2024-09-14T22:46:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63392.log 2024-09-14T22:46:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144172.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137002.log 2024-09-14T22:46:42.535 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144172.log.gz 2024-09-14T22:46:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63392.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63392.log.gz 2024-09-14T22:46:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75443.log 2024-09-14T22:46:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137002.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137002.log.gz 2024-09-14T22:46:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42591.log 2024-09-14T22:46:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75443.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99857.log 2024-09-14T22:46:42.538 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75443.log.gz 2024-09-14T22:46:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42591.log.gz 2024-09-14T22:46:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95032.log 2024-09-14T22:46:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99857.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.99857.log.gz 2024-09-14T22:46:42.539 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.81672.log 2024-09-14T22:46:42.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95032.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83239.log 2024-09-14T22:46:42.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95032.log.gz 2024-09-14T22:46:42.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81672.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61690.log 2024-09-14T22:46:42.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81672.log.gz 2024-09-14T22:46:42.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83239.log.gz 2024-09-14T22:46:42.541 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85940.log 2024-09-14T22:46:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61690.log.gz 2024-09-14T22:46:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99021.log 2024-09-14T22:46:42.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85940.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63160.log 2024-09-14T22:46:42.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85940.log.gz 2024-09-14T22:46:42.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99021.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99021.log.gz 2024-09-14T22:46:42.544 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54921.log 2024-09-14T22:46:42.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63160.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109971.log 2024-09-14T22:46:42.544 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63160.log.gz 2024-09-14T22:46:42.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54921.log.gz 2024-09-14T22:46:42.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65617.log 2024-09-14T22:46:42.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109971.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109971.log.gz 2024-09-14T22:46:42.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75381.log 2024-09-14T22:46:42.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65617.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92313.log 2024-09-14T22:46:42.547 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65617.log.gz 2024-09-14T22:46:42.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75381.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75381.log.gz 2024-09-14T22:46:42.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74265.log 2024-09-14T22:46:42.548 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92313.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92313.log.gz 2024-09-14T22:46:42.548 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46933.log 2024-09-14T22:46:42.548 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74265.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.74265.log.gz -5 2024-09-14T22:46:42.548 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.46222.log 2024-09-14T22:46:42.549 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46933.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47368.log 2024-09-14T22:46:42.549 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46933.log.gz 2024-09-14T22:46:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131521.log 2024-09-14T22:46:42.550 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46222.log.gz 2024-09-14T22:46:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47368.log.gz 2024-09-14T22:46:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114826.log 2024-09-14T22:46:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131521.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131521.log.gz 2024-09-14T22:46:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.35187.log 2024-09-14T22:46:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114826.log.gzgzip 2024-09-14T22:46:42.552 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123640.log 2024-09-14T22:46:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.35187.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.35187.log.gz 2024-09-14T22:46:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69311.log 2024-09-14T22:46:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123640.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123640.log.gz 2024-09-14T22:46:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81866.log 2024-09-14T22:46:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69311.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108321.log 2024-09-14T22:46:42.554 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69311.log.gz 2024-09-14T22:46:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81866.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81866.log.gz 2024-09-14T22:46:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74813.log 2024-09-14T22:46:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108321.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108321.log.gz -5 2024-09-14T22:46:42.556 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.48094.log 2024-09-14T22:46:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74813.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74813.log.gz 2024-09-14T22:46:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42657.log 2024-09-14T22:46:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48094.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48094.log.gz 2024-09-14T22:46:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48966.log 2024-09-14T22:46:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42657.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42657.log.gz 2024-09-14T22:46:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101624.log 2024-09-14T22:46:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48966.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48966.log.gz 2024-09-14T22:46:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149462.log 2024-09-14T22:46:42.560 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101624.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56770.log 2024-09-14T22:46:42.560 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101624.log.gz 2024-09-14T22:46:42.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149462.log.gz 2024-09-14T22:46:42.561 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87097.log 2024-09-14T22:46:42.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56770.log.gz 2024-09-14T22:46:42.561 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66731.log 2024-09-14T22:46:42.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87097.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132854.log 2024-09-14T22:46:42.562 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87097.log.gz 2024-09-14T22:46:42.563 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66731.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66731.log.gz 2024-09-14T22:46:42.563 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138358.log 2024-09-14T22:46:42.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132854.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132854.log.gz 2024-09-14T22:46:42.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137126.log 2024-09-14T22:46:42.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138358.log.gz 2024-09-14T22:46:42.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99629.log 2024-09-14T22:46:42.565 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137126.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63749.log 2024-09-14T22:46:42.565 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137126.log.gz 2024-09-14T22:46:42.566 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99629.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99629.log.gz 2024-09-14T22:46:42.566 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112241.log 2024-09-14T22:46:42.567 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63749.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46860.log 2024-09-14T22:46:42.567 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63749.log.gz 2024-09-14T22:46:42.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112241.log.gz 2024-09-14T22:46:42.568 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94710.log 2024-09-14T22:46:42.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46860.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46860.log.gz 2024-09-14T22:46:42.569 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67605.log 2024-09-14T22:46:42.570 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.141822.log 2024-09-14T22:46:42.570 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94710.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94710.log.gz 2024-09-14T22:46:42.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67605.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67605.log.gz 2024-09-14T22:46:42.571 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63687.log 2024-09-14T22:46:42.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.141822.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.141822.log.gzgzip 2024-09-14T22:46:42.571 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108439.log 2024-09-14T22:46:42.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63687.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63687.log.gz 2024-09-14T22:46:42.572 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95242.log 2024-09-14T22:46:42.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108439.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99944.log 2024-09-14T22:46:42.573 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108439.log.gz 2024-09-14T22:46:42.574 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95242.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95242.log.gz 2024-09-14T22:46:42.574 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94140.log 2024-09-14T22:46:42.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99944.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85269.log 2024-09-14T22:46:42.575 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99944.log.gz 2024-09-14T22:46:42.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94140.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94140.log.gz 2024-09-14T22:46:42.575 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147025.log 2024-09-14T22:46:42.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85269.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64000.log 2024-09-14T22:46:42.576 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85269.log.gz 2024-09-14T22:46:42.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147025.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151190.log 2024-09-14T22:46:42.577 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147025.log.gz 2024-09-14T22:46:42.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64000.log.gz 2024-09-14T22:46:42.578 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82684.log 2024-09-14T22:46:42.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151190.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42010.log 2024-09-14T22:46:42.578 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151190.log.gz 2024-09-14T22:46:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82684.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82684.log.gz 2024-09-14T22:46:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103924.log 2024-09-14T22:46:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42010.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42010.log.gz 2024-09-14T22:46:42.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145030.log 2024-09-14T22:46:42.580 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103924.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78896.log 2024-09-14T22:46:42.580 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103924.log.gz 2024-09-14T22:46:42.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145030.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51374.log 2024-09-14T22:46:42.581 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145030.log.gz 2024-09-14T22:46:42.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78896.log.gz 2024-09-14T22:46:42.581 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92123.log 2024-09-14T22:46:42.582 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51374.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130499.log 2024-09-14T22:46:42.582 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51374.log.gz 2024-09-14T22:46:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92123.log.gz 2024-09-14T22:46:42.583 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141439.log 2024-09-14T22:46:42.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130499.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130499.log.gz 2024-09-14T22:46:42.584 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78826.log 2024-09-14T22:46:42.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141439.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141439.log.gz 2024-09-14T22:46:42.584 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38465.log 2024-09-14T22:46:42.585 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78826.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51651.log 2024-09-14T22:46:42.585 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78826.log.gz 2024-09-14T22:46:42.586 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38465.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.38465.log.gz -5 2024-09-14T22:46:42.586 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.114172.log 2024-09-14T22:46:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51651.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51651.log.gz 2024-09-14T22:46:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36658.log 2024-09-14T22:46:42.587 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114172.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114172.log.gz 2024-09-14T22:46:42.588 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60178.log 2024-09-14T22:46:42.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36658.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110201.log 2024-09-14T22:46:42.588 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36658.log.gz 2024-09-14T22:46:42.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60178.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60178.log.gz 2024-09-14T22:46:42.589 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79698.log 2024-09-14T22:46:42.590 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110201.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143949.log 2024-09-14T22:46:42.590 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110201.log.gz 2024-09-14T22:46:42.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79698.log.gz 2024-09-14T22:46:42.591 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142525.log 2024-09-14T22:46:42.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143949.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123058.log 2024-09-14T22:46:42.591 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143949.log.gz 2024-09-14T22:46:42.592 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142525.log.gz 2024-09-14T22:46:42.592 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107738.log 2024-09-14T22:46:42.593 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123058.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.49465.log -- replaced with /var/log/ceph/cluster1-client.mirror.123058.log.gz 2024-09-14T22:46:42.593 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107738.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107738.log.gz 2024-09-14T22:46:42.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50935.log 2024-09-14T22:46:42.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49465.log.gz 2024-09-14T22:46:42.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125599.log 2024-09-14T22:46:42.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50935.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50935.log.gz -5 --verbose 2024-09-14T22:46:42.595 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.41105.log 2024-09-14T22:46:42.596 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125599.log.gz 2024-09-14T22:46:42.596 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143031.log 2024-09-14T22:46:42.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41105.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.41105.log.gz --verbose 2024-09-14T22:46:42.597 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.mirror.139700.log 2024-09-14T22:46:42.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143031.log.gz 2024-09-14T22:46:42.598 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47791.log 2024-09-14T22:46:42.598 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.139700.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129316.log 2024-09-14T22:46:42.598 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.139700.log.gz 2024-09-14T22:46:42.599 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47791.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47791.log.gz 2024-09-14T22:46:42.599 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106452.log 2024-09-14T22:46:42.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129316.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129316.log.gzgzip 2024-09-14T22:46:42.600 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.34069.log 2024-09-14T22:46:42.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106452.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106452.log.gz 2024-09-14T22:46:42.601 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76849.log 2024-09-14T22:46:42.601 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34069.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141361.log 2024-09-14T22:46:42.601 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34069.log.gz 2024-09-14T22:46:42.602 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76849.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.76849.log.gz 2024-09-14T22:46:42.602 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110643.log 2024-09-14T22:46:42.603 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141361.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141361.log.gz 2024-09-14T22:46:42.603 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113035.log 2024-09-14T22:46:42.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110643.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110643.log.gz 2024-09-14T22:46:42.604 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97232.log 2024-09-14T22:46:42.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113035.log.gz 2024-09-14T22:46:42.605 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43861.log 2024-09-14T22:46:42.605 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97232.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97232.log.gz 2024-09-14T22:46:42.605 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119355.log 2024-09-14T22:46:42.606 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43861.log.gz 2024-09-14T22:46:42.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97610.log 2024-09-14T22:46:42.607 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119355.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152427.log 2024-09-14T22:46:42.607 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119355.log.gz 2024-09-14T22:46:42.607 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97610.log.gz 2024-09-14T22:46:42.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107623.log 2024-09-14T22:46:42.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152427.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152427.log.gz 2024-09-14T22:46:42.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38334.log 2024-09-14T22:46:42.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107623.log.gzgzip 2024-09-14T22:46:42.609 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99351.log 2024-09-14T22:46:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38334.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38334.log.gz 2024-09-14T22:46:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141348.log 2024-09-14T22:46:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99351.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99351.log.gz 2024-09-14T22:46:42.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94669.log 2024-09-14T22:46:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141348.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141348.log.gz 2024-09-14T22:46:42.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71622.log 2024-09-14T22:46:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94669.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94669.log.gz 2024-09-14T22:46:42.612 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87662.log 2024-09-14T22:46:42.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71622.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.71622.log.gz 2024-09-14T22:46:42.613 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64778.log 2024-09-14T22:46:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87662.log.gz 2024-09-14T22:46:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34965.log 2024-09-14T22:46:42.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64778.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78092.log 2024-09-14T22:46:42.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64778.log.gz 2024-09-14T22:46:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.34965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34965.log.gz 2024-09-14T22:46:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119007.log 2024-09-14T22:46:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78092.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43219.log 2024-09-14T22:46:42.616 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78092.log.gz 2024-09-14T22:46:42.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119007.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119007.log.gz 2024-09-14T22:46:42.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129648.log 2024-09-14T22:46:42.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43219.log.gz 2024-09-14T22:46:42.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77711.log 2024-09-14T22:46:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129648.log.gzgzip 2024-09-14T22:46:42.618 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120036.log 2024-09-14T22:46:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77711.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77711.log.gz 2024-09-14T22:46:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105332.log 2024-09-14T22:46:42.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120036.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120036.log.gz 2024-09-14T22:46:42.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142635.log 2024-09-14T22:46:42.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105332.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105332.log.gz 2024-09-14T22:46:42.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57564.log 2024-09-14T22:46:42.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142635.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142635.log.gz 2024-09-14T22:46:42.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95198.log 2024-09-14T22:46:42.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57564.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57564.log.gz 2024-09-14T22:46:42.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152653.log 2024-09-14T22:46:42.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95198.log.gz 2024-09-14T22:46:42.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52909.log 2024-09-14T22:46:42.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152653.log.gz 2024-09-14T22:46:42.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43597.log 2024-09-14T22:46:42.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52909.log.gz 2024-09-14T22:46:42.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118410.log 2024-09-14T22:46:42.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43597.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43597.log.gz 2024-09-14T22:46:42.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130017.log 2024-09-14T22:46:42.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118410.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118410.log.gz 2024-09-14T22:46:42.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87896.log 2024-09-14T22:46:42.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130017.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144720.log 2024-09-14T22:46:42.627 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130017.log.gz 2024-09-14T22:46:42.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87896.log.gz 2024-09-14T22:46:42.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110221.log 2024-09-14T22:46:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144720.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144720.log.gz 2024-09-14T22:46:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44420.log 2024-09-14T22:46:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110221.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50389.log 2024-09-14T22:46:42.629 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110221.log.gz 2024-09-14T22:46:42.630 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44420.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44420.log.gz 2024-09-14T22:46:42.630 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82980.log 2024-09-14T22:46:42.631 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50389.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50389.log.gz 2024-09-14T22:46:42.631 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38715.log 2024-09-14T22:46:42.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82980.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86969.log 2024-09-14T22:46:42.632 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82980.log.gz 2024-09-14T22:46:42.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38715.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38715.log.gz 2024-09-14T22:46:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132650.log 2024-09-14T22:46:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86969.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86969.log.gz 2024-09-14T22:46:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.127853.log 2024-09-14T22:46:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132650.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50264.log 2024-09-14T22:46:42.634 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132650.log.gz 2024-09-14T22:46:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.127853.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.127853.log.gz 2024-09-14T22:46:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41384.log 2024-09-14T22:46:42.636 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50264.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50264.log.gz 2024-09-14T22:46:42.636 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113123.log 2024-09-14T22:46:42.637 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41384.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41384.log.gz 2024-09-14T22:46:42.637 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37160.log 2024-09-14T22:46:42.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113123.log.gz 2024-09-14T22:46:42.638 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54989.log 2024-09-14T22:46:42.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37160.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78379.log 2024-09-14T22:46:42.639 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37160.log.gz 2024-09-14T22:46:42.639 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54989.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54989.log.gz 2024-09-14T22:46:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41278.log 2024-09-14T22:46:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78379.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78379.log.gz 2024-09-14T22:46:42.640 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133238.log 2024-09-14T22:46:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41278.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.41278.log.gz -5 2024-09-14T22:46:42.641 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.133379.log 2024-09-14T22:46:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133238.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138225.log 2024-09-14T22:46:42.642 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133238.log.gz 2024-09-14T22:46:42.642 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133379.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133379.log.gz 2024-09-14T22:46:42.642 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61456.log 2024-09-14T22:46:42.643 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138225.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138225.log.gz 2024-09-14T22:46:42.643 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102063.log 2024-09-14T22:46:42.644 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61456.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88187.log 2024-09-14T22:46:42.644 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61456.log.gz 2024-09-14T22:46:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102063.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102063.log.gz 2024-09-14T22:46:42.645 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77161.log 2024-09-14T22:46:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88187.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139198.log 2024-09-14T22:46:42.646 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88187.log.gz 2024-09-14T22:46:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77161.log.gz 2024-09-14T22:46:42.646 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.29644.log 2024-09-14T22:46:42.647 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139198.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82383.log 2024-09-14T22:46:42.647 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139198.log.gz 2024-09-14T22:46:42.648 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29644.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.29644.log.gz 2024-09-14T22:46:42.648 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52323.log 2024-09-14T22:46:42.649 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82383.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82383.log.gz 2024-09-14T22:46:42.649 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72904.log 2024-09-14T22:46:42.649 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52323.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76116.log 2024-09-14T22:46:42.649 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52323.log.gz 2024-09-14T22:46:42.650 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72904.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70461.log 2024-09-14T22:46:42.650 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72904.log.gz 2024-09-14T22:46:42.651 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76116.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76116.log.gz 2024-09-14T22:46:42.651 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117113.log 2024-09-14T22:46:42.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70461.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70461.log.gz 2024-09-14T22:46:42.652 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110913.log 2024-09-14T22:46:42.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117113.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117113.log.gz 2024-09-14T22:46:42.652 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71359.log 2024-09-14T22:46:42.653 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110913.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142371.log 2024-09-14T22:46:42.653 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110913.log.gz 2024-09-14T22:46:42.654 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71359.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71359.log.gz -5 2024-09-14T22:46:42.654 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.77458.log 2024-09-14T22:46:42.655 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142371.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142371.log.gz 2024-09-14T22:46:42.655 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98157.log 2024-09-14T22:46:42.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77458.log.gz 2024-09-14T22:46:42.656 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85396.log 2024-09-14T22:46:42.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98157.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126769.log 2024-09-14T22:46:42.656 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98157.log.gz 2024-09-14T22:46:42.657 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85396.log.gz 2024-09-14T22:46:42.657 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100953.log 2024-09-14T22:46:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126769.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126769.log.gz 2024-09-14T22:46:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122066.log 2024-09-14T22:46:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100953.log.gz 2024-09-14T22:46:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119186.log 2024-09-14T22:46:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122066.log.gz 2024-09-14T22:46:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124693.log 2024-09-14T22:46:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119186.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119186.log.gz 2024-09-14T22:46:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96962.log 2024-09-14T22:46:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124693.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124693.log.gz 2024-09-14T22:46:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145851.log 2024-09-14T22:46:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96962.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98115.log 2024-09-14T22:46:42.662 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96962.log.gz 2024-09-14T22:46:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145851.log.gz 2024-09-14T22:46:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79918.log 2024-09-14T22:46:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98115.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98115.log.gz 2024-09-14T22:46:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57329.log 2024-09-14T22:46:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79918.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79918.log.gz 2024-09-14T22:46:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59525.log 2024-09-14T22:46:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57329.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57329.log.gz 2024-09-14T22:46:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68520.log 2024-09-14T22:46:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59525.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59525.log.gz -5 2024-09-14T22:46:42.666 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.72753.log 2024-09-14T22:46:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68520.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68520.log.gz 2024-09-14T22:46:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47332.log 2024-09-14T22:46:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72753.log.gz 2024-09-14T22:46:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145092.log 2024-09-14T22:46:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47332.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100321.log 2024-09-14T22:46:42.668 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47332.log.gz 2024-09-14T22:46:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145092.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145092.log.gz 2024-09-14T22:46:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121037.log 2024-09-14T22:46:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100321.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150110.log 2024-09-14T22:46:42.670 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100321.log.gz 2024-09-14T22:46:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121037.log.gz 2024-09-14T22:46:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60636.log 2024-09-14T22:46:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150110.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150110.log.gz 2024-09-14T22:46:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51019.log 2024-09-14T22:46:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60636.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49067.log 2024-09-14T22:46:42.672 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60636.log.gz 2024-09-14T22:46:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51019.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51019.log.gz 2024-09-14T22:46:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39349.log 2024-09-14T22:46:42.674 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49067.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49067.log.gz 2024-09-14T22:46:42.674 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48920.log 2024-09-14T22:46:42.675 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39349.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.39349.log.gz 2024-09-14T22:46:42.675 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.110536.log 2024-09-14T22:46:42.675 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48920.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48920.log.gz 2024-09-14T22:46:42.675 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140528.log 2024-09-14T22:46:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110536.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110536.log.gz 2024-09-14T22:46:42.676 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71528.log 2024-09-14T22:46:42.677 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140528.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150883.log 2024-09-14T22:46:42.677 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140528.log.gz 2024-09-14T22:46:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71528.log.gz 2024-09-14T22:46:42.678 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81101.log 2024-09-14T22:46:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150883.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150883.log.gz 2024-09-14T22:46:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151517.log 2024-09-14T22:46:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81101.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81101.log.gz 2024-09-14T22:46:42.679 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116741.log 2024-09-14T22:46:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151517.log.gz 2024-09-14T22:46:42.680 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54127.log 2024-09-14T22:46:42.681 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116741.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77333.log 2024-09-14T22:46:42.681 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116741.log.gz 2024-09-14T22:46:42.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54127.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54127.log.gz 2024-09-14T22:46:42.682 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154002.log 2024-09-14T22:46:42.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77333.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48248.log 2024-09-14T22:46:42.683 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77333.log.gz 2024-09-14T22:46:42.683 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154002.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154002.log.gz 2024-09-14T22:46:42.683 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53077.log 2024-09-14T22:46:42.684 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48248.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47680.log 2024-09-14T22:46:42.684 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48248.log.gz 2024-09-14T22:46:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53077.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53077.log.gz 2024-09-14T22:46:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145101.log 2024-09-14T22:46:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47680.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47680.log.gz 2024-09-14T22:46:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93315.log 2024-09-14T22:46:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145101.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145101.log.gz 2024-09-14T22:46:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107433.log 2024-09-14T22:46:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93315.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93315.log.gz 2024-09-14T22:46:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78848.log 2024-09-14T22:46:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107433.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66480.log 2024-09-14T22:46:42.688 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107433.log.gz 2024-09-14T22:46:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78848.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78848.log.gz 2024-09-14T22:46:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62616.log 2024-09-14T22:46:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66480.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66480.log.gz 2024-09-14T22:46:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121749.log 2024-09-14T22:46:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62616.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.62616.log.gz 2024-09-14T22:46:42.690 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.115573.log 2024-09-14T22:46:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121749.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121749.log.gz 2024-09-14T22:46:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64884.log 2024-09-14T22:46:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115573.log.gz 2024-09-14T22:46:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102598.log 2024-09-14T22:46:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64884.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.64884.log.gz 2024-09-14T22:46:42.693 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.154995.log 2024-09-14T22:46:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102598.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102598.log.gz 2024-09-14T22:46:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134219.log 2024-09-14T22:46:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154995.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.52995.log -- replaced with /var/log/ceph/cluster2-client.admin.154995.log.gz 2024-09-14T22:46:42.694 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134219.log.gz 2024-09-14T22:46:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126689.log 2024-09-14T22:46:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52995.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52995.log.gz 2024-09-14T22:46:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65911.log 2024-09-14T22:46:42.697 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126689.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126689.log.gzgzip 2024-09-14T22:46:42.697 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122305.log 2024-09-14T22:46:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65911.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65911.log.gz 2024-09-14T22:46:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60332.log 2024-09-14T22:46:42.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122305.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121646.log 2024-09-14T22:46:42.699 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122305.log.gz 2024-09-14T22:46:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60332.log.gz 2024-09-14T22:46:42.699 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64399.log 2024-09-14T22:46:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121646.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121646.log.gz 2024-09-14T22:46:42.700 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101831.log 2024-09-14T22:46:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64399.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64399.log.gz 2024-09-14T22:46:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54213.log 2024-09-14T22:46:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101831.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101831.log.gz 2024-09-14T22:46:42.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141459.log 2024-09-14T22:46:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54213.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54213.log.gz 2024-09-14T22:46:42.702 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41697.log 2024-09-14T22:46:42.703 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141459.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141459.log.gz 2024-09-14T22:46:42.703 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36083.log 2024-09-14T22:46:42.704 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41697.log.gz 2024-09-14T22:46:42.704 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55530.log 2024-09-14T22:46:42.705 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36083.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36083.log.gz 2024-09-14T22:46:42.705 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100533.log 2024-09-14T22:46:42.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55530.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55530.log.gz 2024-09-14T22:46:42.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134473.log 2024-09-14T22:46:42.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100533.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100533.log.gz 2024-09-14T22:46:42.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84418.log 2024-09-14T22:46:42.707 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134473.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134473.log.gz 2024-09-14T22:46:42.707 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118658.log 2024-09-14T22:46:42.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84418.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84418.log.gz 2024-09-14T22:46:42.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85310.log 2024-09-14T22:46:42.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118658.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118658.log.gz 2024-09-14T22:46:42.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77878.log 2024-09-14T22:46:42.710 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85310.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85310.log.gz 2024-09-14T22:46:42.710 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98577.log 2024-09-14T22:46:42.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77878.log.gz 2024-09-14T22:46:42.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64651.log 2024-09-14T22:46:42.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98577.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98577.log.gz 2024-09-14T22:46:42.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42367.log 2024-09-14T22:46:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64651.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64651.log.gz 2024-09-14T22:46:42.712 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93333.log 2024-09-14T22:46:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42367.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42367.log.gz 2024-09-14T22:46:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93205.log 2024-09-14T22:46:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93333.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93333.log.gz 2024-09-14T22:46:42.713 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55804.log 2024-09-14T22:46:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93205.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93205.log.gz 2024-09-14T22:46:42.714 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48705.log 2024-09-14T22:46:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55804.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55804.log.gz 2024-09-14T22:46:42.715 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67963.log 2024-09-14T22:46:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48705.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48705.log.gz 2024-09-14T22:46:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121606.log 2024-09-14T22:46:42.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67963.log.gz 2024-09-14T22:46:42.720 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64126.log 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121606.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121606.log.gz 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131984.log 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64126.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64126.log.gz 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144236.log 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131984.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131984.log.gz 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111551.log 2024-09-14T22:46:42.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144236.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144236.log.gz 2024-09-14T22:46:42.723 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126435.log 2024-09-14T22:46:42.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111551.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111551.log.gz 2024-09-14T22:46:42.723 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140426.log 2024-09-14T22:46:42.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126435.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126435.log.gz 2024-09-14T22:46:42.723 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147745.log 2024-09-14T22:46:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140426.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140426.log.gz 2024-09-14T22:46:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119469.log 2024-09-14T22:46:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147745.log.gz 2024-09-14T22:46:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144652.log 2024-09-14T22:46:42.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119469.log.gz 2024-09-14T22:46:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54767.log 2024-09-14T22:46:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144652.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144652.log.gz 2024-09-14T22:46:42.725 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64573.log 2024-09-14T22:46:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54767.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54767.log.gz 2024-09-14T22:46:42.726 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78897.log 2024-09-14T22:46:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64573.log.gz 2024-09-14T22:46:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133169.log 2024-09-14T22:46:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78897.log.gz 2024-09-14T22:46:42.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112594.log 2024-09-14T22:46:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133169.log.gz 2024-09-14T22:46:42.728 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74477.log 2024-09-14T22:46:42.729 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112594.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112594.log.gz 2024-09-14T22:46:42.729 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138372.log 2024-09-14T22:46:42.730 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74477.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74477.log.gz 2024-09-14T22:46:42.730 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142257.log 2024-09-14T22:46:42.730 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138372.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138372.log.gz 2024-09-14T22:46:42.731 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68518.log 2024-09-14T22:46:42.731 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142257.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142257.log.gz 2024-09-14T22:46:42.731 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69900.log 2024-09-14T22:46:42.732 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68518.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68518.log.gz 2024-09-14T22:46:42.732 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124955.log 2024-09-14T22:46:42.733 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69900.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69900.log.gz 2024-09-14T22:46:42.733 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91727.log 2024-09-14T22:46:42.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124955.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124955.log.gz 2024-09-14T22:46:42.734 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110220.log 2024-09-14T22:46:42.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91727.log.gz 2024-09-14T22:46:42.735 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122742.log 2024-09-14T22:46:42.735 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110220.log.gz 2024-09-14T22:46:42.735 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77960.log 2024-09-14T22:46:42.736 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122742.log.gz 2024-09-14T22:46:42.736 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62618.log 2024-09-14T22:46:42.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77960.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77960.log.gz 2024-09-14T22:46:42.737 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136921.log 2024-09-14T22:46:42.738 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62618.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62618.log.gz 2024-09-14T22:46:42.738 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105763.log 2024-09-14T22:46:42.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136921.log.gz 2024-09-14T22:46:42.739 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49382.log 2024-09-14T22:46:42.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105763.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105763.log.gz 2024-09-14T22:46:42.740 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52281.log 2024-09-14T22:46:42.740 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49382.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49382.log.gz 2024-09-14T22:46:42.740 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107170.log 2024-09-14T22:46:42.741 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52281.log.gz 2024-09-14T22:46:42.741 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107036.log 2024-09-14T22:46:42.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107170.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107170.log.gz 2024-09-14T22:46:42.742 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130783.log 2024-09-14T22:46:42.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107036.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107036.log.gz 2024-09-14T22:46:42.743 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78764.log 2024-09-14T22:46:42.743 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130783.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130783.log.gz 2024-09-14T22:46:42.743 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126361.log 2024-09-14T22:46:42.744 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78764.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78764.log.gz 2024-09-14T22:46:42.744 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130063.log 2024-09-14T22:46:42.745 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126361.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126361.log.gz 2024-09-14T22:46:42.745 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126626.log 2024-09-14T22:46:42.746 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130063.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130063.log.gz 2024-09-14T22:46:42.746 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118699.log 2024-09-14T22:46:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126626.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126626.log.gz 2024-09-14T22:46:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73950.log 2024-09-14T22:46:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118699.log.gz 2024-09-14T22:46:42.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126336.log 2024-09-14T22:46:42.748 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73950.log.gz 2024-09-14T22:46:42.748 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73699.log 2024-09-14T22:46:42.749 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126336.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126336.log.gz 2024-09-14T22:46:42.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115460.log 2024-09-14T22:46:42.750 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73699.log.gz 2024-09-14T22:46:42.750 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124000.log 2024-09-14T22:46:42.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115460.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115460.log.gz 2024-09-14T22:46:42.751 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61880.log 2024-09-14T22:46:42.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124000.log.gz 2024-09-14T22:46:42.752 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69142.log 2024-09-14T22:46:42.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61880.log.gz 2024-09-14T22:46:42.752 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58724.log 2024-09-14T22:46:42.753 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69142.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69142.log.gz 2024-09-14T22:46:42.753 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89529.log 2024-09-14T22:46:42.754 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58724.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58724.log.gz 2024-09-14T22:46:42.754 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117134.log 2024-09-14T22:46:42.755 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89529.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89529.log.gz 2024-09-14T22:46:42.755 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87601.log 2024-09-14T22:46:42.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117134.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117134.log.gz 2024-09-14T22:46:42.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69167.log 2024-09-14T22:46:42.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87601.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87601.log.gz 2024-09-14T22:46:42.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85648.log 2024-09-14T22:46:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69167.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69167.log.gz 2024-09-14T22:46:42.757 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148020.log 2024-09-14T22:46:42.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85648.log.gz 2024-09-14T22:46:42.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101371.log 2024-09-14T22:46:42.759 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148020.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148020.log.gz 2024-09-14T22:46:42.759 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92177.log 2024-09-14T22:46:42.760 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101371.log.gz 2024-09-14T22:46:42.760 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141983.log 2024-09-14T22:46:42.760 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92177.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92177.log.gz 2024-09-14T22:46:42.761 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76496.log 2024-09-14T22:46:42.761 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141983.log.gz 2024-09-14T22:46:42.761 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37913.log 2024-09-14T22:46:42.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76496.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76496.log.gz 2024-09-14T22:46:42.762 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140325.log 2024-09-14T22:46:42.763 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37913.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37913.log.gz 2024-09-14T22:46:42.763 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72469.log 2024-09-14T22:46:42.764 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140325.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140325.log.gz 2024-09-14T22:46:42.764 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77395.log 2024-09-14T22:46:42.765 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72469.log.gz 2024-09-14T22:46:42.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62804.log 2024-09-14T22:46:42.765 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77395.log.gz 2024-09-14T22:46:42.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122027.log 2024-09-14T22:46:42.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62804.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62804.log.gz 2024-09-14T22:46:42.766 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50055.log 2024-09-14T22:46:42.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122027.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122027.log.gz 2024-09-14T22:46:42.767 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118585.log 2024-09-14T22:46:42.768 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50055.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50055.log.gz 2024-09-14T22:46:42.768 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75799.log 2024-09-14T22:46:42.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118585.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133799.log 0.0% 2024-09-14T22:46:42.769 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.118585.log.gz 2024-09-14T22:46:42.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75799.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75799.log.gz 2024-09-14T22:46:42.769 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149040.log 2024-09-14T22:46:42.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133799.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133799.log.gz 2024-09-14T22:46:42.770 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101541.log 2024-09-14T22:46:42.771 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149040.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149040.log.gz 2024-09-14T22:46:42.771 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103682.log 2024-09-14T22:46:42.772 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101541.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101541.log.gz 2024-09-14T22:46:42.772 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45409.log 2024-09-14T22:46:42.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103682.log.gz 2024-09-14T22:46:42.773 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39999.log 2024-09-14T22:46:42.774 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45409.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45409.log.gz 2024-09-14T22:46:42.774 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49976.log 2024-09-14T22:46:42.774 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39999.log.gz 2024-09-14T22:46:42.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72472.log 2024-09-14T22:46:42.775 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49976.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49976.log.gz 2024-09-14T22:46:42.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62992.log 2024-09-14T22:46:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72472.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72472.log.gz 2024-09-14T22:46:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84644.log 2024-09-14T22:46:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62992.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62992.log.gz 2024-09-14T22:46:42.777 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119622.log 2024-09-14T22:46:42.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84644.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84644.log.gz 2024-09-14T22:46:42.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106887.log 2024-09-14T22:46:42.779 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119622.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119622.log.gz 2024-09-14T22:46:42.779 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153345.log 2024-09-14T22:46:42.779 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106887.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106887.log.gz 2024-09-14T22:46:42.779 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119798.log 2024-09-14T22:46:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153345.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153345.log.gz 2024-09-14T22:46:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139307.log 2024-09-14T22:46:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119798.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119798.log.gz 2024-09-14T22:46:42.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144086.log 2024-09-14T22:46:42.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139307.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139307.log.gz 2024-09-14T22:46:42.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.79030.log 2024-09-14T22:46:42.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144086.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144086.log.gz 2024-09-14T22:46:42.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110706.log 2024-09-14T22:46:42.783 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.79030.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.79030.log.gz 2024-09-14T22:46:42.783 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60116.log 2024-09-14T22:46:42.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110706.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110706.log.gz 2024-09-14T22:46:42.784 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135218.log 2024-09-14T22:46:42.785 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60116.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60116.log.gzgzip 2024-09-14T22:46:42.785 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82912.log 2024-09-14T22:46:42.785 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135218.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135218.log.gz 2024-09-14T22:46:42.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153505.log 2024-09-14T22:46:42.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82912.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82912.log.gz 2024-09-14T22:46:42.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104343.log 2024-09-14T22:46:42.787 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153505.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153505.log.gz 2024-09-14T22:46:42.787 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150153.log 2024-09-14T22:46:42.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104343.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104343.log.gz 2024-09-14T22:46:42.788 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101994.log 2024-09-14T22:46:42.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150153.log.gz 2024-09-14T22:46:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118088.log 2024-09-14T22:46:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101994.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101994.log.gz 2024-09-14T22:46:42.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93965.log 2024-09-14T22:46:42.790 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118088.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118088.log.gz 2024-09-14T22:46:42.790 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43192.log 2024-09-14T22:46:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93965.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93965.log.gz 2024-09-14T22:46:42.791 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121480.log 2024-09-14T22:46:42.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43192.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43192.log.gz 2024-09-14T22:46:42.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51027.log 2024-09-14T22:46:42.793 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121480.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121480.log.gz 2024-09-14T22:46:42.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81837.log 2024-09-14T22:46:42.793 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51027.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51027.log.gz 2024-09-14T22:46:42.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75319.log 2024-09-14T22:46:42.794 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81837.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81837.log.gz 2024-09-14T22:46:42.794 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83636.log 2024-09-14T22:46:42.795 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75319.log.gz 2024-09-14T22:46:42.795 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96246.log 2024-09-14T22:46:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83636.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83636.log.gz 2024-09-14T22:46:42.796 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118129.log 2024-09-14T22:46:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96246.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96246.log.gz 2024-09-14T22:46:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115936.log 2024-09-14T22:46:42.797 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118129.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118129.log.gz 2024-09-14T22:46:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112616.log 2024-09-14T22:46:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115936.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115936.log.gz 2024-09-14T22:46:42.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84550.log 2024-09-14T22:46:42.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112616.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112616.log.gz 2024-09-14T22:46:42.799 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54806.log 2024-09-14T22:46:42.800 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84550.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84550.log.gz 2024-09-14T22:46:42.800 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121166.log 2024-09-14T22:46:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54806.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54806.log.gz 2024-09-14T22:46:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54424.log 2024-09-14T22:46:42.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121166.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121166.log.gz 2024-09-14T22:46:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105287.log 2024-09-14T22:46:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54424.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54424.log.gz 2024-09-14T22:46:42.802 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74961.log 2024-09-14T22:46:42.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105287.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39428.log 0.0% 2024-09-14T22:46:42.803 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.mirror.105287.log.gz 2024-09-14T22:46:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74961.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74961.log.gz 2024-09-14T22:46:42.804 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67569.log 2024-09-14T22:46:42.805 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39428.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39428.log.gz 2024-09-14T22:46:42.805 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91726.log 2024-09-14T22:46:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67569.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67569.log.gz 2024-09-14T22:46:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51481.log 2024-09-14T22:46:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91726.log.gz 2024-09-14T22:46:42.806 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52928.log 2024-09-14T22:46:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51481.log.gz 2024-09-14T22:46:42.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74476.log 2024-09-14T22:46:42.808 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52928.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.52928.log.gz --verbose 2024-09-14T22:46:42.808 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.108861.log 2024-09-14T22:46:42.809 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74476.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74476.log.gz 2024-09-14T22:46:42.809 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116278.log 2024-09-14T22:46:42.810 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108861.log.gz 2024-09-14T22:46:42.810 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124212.log 2024-09-14T22:46:42.811 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116278.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116278.log.gz 2024-09-14T22:46:42.811 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128512.log 2024-09-14T22:46:42.811 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124212.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124212.log.gz 2024-09-14T22:46:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87897.log 2024-09-14T22:46:42.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128512.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.admin.45244.log -- replaced with /var/log/ceph/cluster2-client.admin.128512.log.gz 2024-09-14T22:46:42.812 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.813 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87897.log.gz 2024-09-14T22:46:42.813 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128705.log 2024-09-14T22:46:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45244.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45244.log.gz 2024-09-14T22:46:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56969.log 2024-09-14T22:46:42.814 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128705.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128705.log.gz 2024-09-14T22:46:42.815 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74855.log 2024-09-14T22:46:42.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56969.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56969.log.gz 2024-09-14T22:46:42.815 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141687.log 2024-09-14T22:46:42.816 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74855.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74855.log.gz 2024-09-14T22:46:42.816 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82778.log 2024-09-14T22:46:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141687.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141687.log.gzgzip 2024-09-14T22:46:42.817 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101939.log 2024-09-14T22:46:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82778.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82778.log.gz 2024-09-14T22:46:42.817 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95899.log 2024-09-14T22:46:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101939.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101939.log.gz 2024-09-14T22:46:42.818 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46268.log 2024-09-14T22:46:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95899.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95899.log.gz 2024-09-14T22:46:42.819 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131895.log 2024-09-14T22:46:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46268.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46268.log.gz 2024-09-14T22:46:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127654.log 2024-09-14T22:46:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131895.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131895.log.gz 2024-09-14T22:46:42.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116006.log 2024-09-14T22:46:42.821 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127654.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127654.log.gz 2024-09-14T22:46:42.821 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136417.log 2024-09-14T22:46:42.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116006.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116006.log.gz 2024-09-14T22:46:42.822 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50515.log 2024-09-14T22:46:42.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136417.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136417.log.gz 2024-09-14T22:46:42.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135344.log 2024-09-14T22:46:42.823 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50515.log.gz 2024-09-14T22:46:42.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132049.log 2024-09-14T22:46:42.824 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135344.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86822.log 2024-09-14T22:46:42.824 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135344.log.gz 2024-09-14T22:46:42.825 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132049.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132049.log.gz 2024-09-14T22:46:42.825 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93596.log 2024-09-14T22:46:42.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86822.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86822.log.gz 2024-09-14T22:46:42.826 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68046.log 2024-09-14T22:46:42.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93596.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93596.log.gz 2024-09-14T22:46:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131522.log 2024-09-14T22:46:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68046.log.gz 2024-09-14T22:46:42.827 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136707.log 2024-09-14T22:46:42.828 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131522.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.131522.log.gz -- 2024-09-14T22:46:42.828 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.59299.log 2024-09-14T22:46:42.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136707.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136707.log.gz 2024-09-14T22:46:42.829 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119576.log 2024-09-14T22:46:42.830 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59299.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59299.log.gz -5 2024-09-14T22:46:42.830 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.97088.log 2024-09-14T22:46:42.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119576.log.gz 2024-09-14T22:46:42.831 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74326.log 2024-09-14T22:46:42.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97088.log.gz 2024-09-14T22:46:42.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48548.log 2024-09-14T22:46:42.832 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74326.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74326.log.gz 2024-09-14T22:46:42.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111691.log 2024-09-14T22:46:42.833 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48548.log.gz 2024-09-14T22:46:42.833 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85186.log 2024-09-14T22:46:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111691.log.gz 2024-09-14T22:46:42.834 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98220.log 2024-09-14T22:46:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85186.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85186.log.gz 2024-09-14T22:46:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107074.log 2024-09-14T22:46:42.835 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98220.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.98220.log.gz --verbose 2024-09-14T22:46:42.836 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.64926.log 2024-09-14T22:46:42.836 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107074.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107074.log.gz 2024-09-14T22:46:42.836 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147742.log 2024-09-14T22:46:42.837 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64926.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64926.log.gz 2024-09-14T22:46:42.837 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94368.log 2024-09-14T22:46:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147742.log.gz 2024-09-14T22:46:42.838 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93874.log 2024-09-14T22:46:42.839 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94368.log.gz 2024-09-14T22:46:42.839 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60727.log 2024-09-14T22:46:42.839 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93874.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93874.log.gz 2024-09-14T22:46:42.840 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78717.log 2024-09-14T22:46:42.840 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60727.log.gz 2024-09-14T22:46:42.840 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78487.log 2024-09-14T22:46:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78717.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78717.log.gz 2024-09-14T22:46:42.841 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139571.log 2024-09-14T22:46:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78487.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78487.log.gz 2024-09-14T22:46:42.842 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112029.log 2024-09-14T22:46:42.843 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139571.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139571.log.gz 2024-09-14T22:46:42.843 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74435.log 2024-09-14T22:46:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112029.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112029.log.gz 2024-09-14T22:46:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81291.log 2024-09-14T22:46:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74435.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74435.log.gz 2024-09-14T22:46:42.844 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101538.log 2024-09-14T22:46:42.845 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81291.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81291.log.gz 2024-09-14T22:46:42.845 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129289.log 2024-09-14T22:46:42.846 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101538.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101538.log.gz 2024-09-14T22:46:42.846 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134397.log 2024-09-14T22:46:42.847 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129289.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129289.log.gz 2024-09-14T22:46:42.847 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76535.log 2024-09-14T22:46:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134397.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134397.log.gz 2024-09-14T22:46:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143394.log 2024-09-14T22:46:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76535.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76535.log.gz 2024-09-14T22:46:42.848 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94421.log 2024-09-14T22:46:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143394.log.gz 2024-09-14T22:46:42.849 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146732.log 2024-09-14T22:46:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94421.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94421.log.gz 2024-09-14T22:46:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97277.log 2024-09-14T22:46:42.850 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146732.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146732.log.gz 2024-09-14T22:46:42.851 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75698.log 2024-09-14T22:46:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97277.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97277.log.gz 2024-09-14T22:46:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96667.log 2024-09-14T22:46:42.852 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75698.log.gz 2024-09-14T22:46:42.853 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94623.log 2024-09-14T22:46:42.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96667.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96667.log.gz 2024-09-14T22:46:42.853 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89701.log 2024-09-14T22:46:42.854 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94623.log.gz 2024-09-14T22:46:42.854 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144653.log 2024-09-14T22:46:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89701.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89701.log.gz 2024-09-14T22:46:42.855 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.60222.log 2024-09-14T22:46:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144653.log.gz 2024-09-14T22:46:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151345.log 2024-09-14T22:46:42.856 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.60222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.60222.log.gz 2024-09-14T22:46:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40549.log 2024-09-14T22:46:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151345.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151345.log.gz 2024-09-14T22:46:42.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61858.log 2024-09-14T22:46:42.858 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40549.log.gz 2024-09-14T22:46:42.858 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45408.log 2024-09-14T22:46:42.859 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61858.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61858.log.gz 2024-09-14T22:46:42.859 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117746.log 2024-09-14T22:46:42.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45408.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45408.log.gz 2024-09-14T22:46:42.860 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146312.log 2024-09-14T22:46:42.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117746.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117746.log.gz 2024-09-14T22:46:42.860 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38084.log 2024-09-14T22:46:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146312.log.gz 2024-09-14T22:46:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41914.log 2024-09-14T22:46:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38084.log.gz 2024-09-14T22:46:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89448.log 2024-09-14T22:46:42.863 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41914.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41914.log.gz 2024-09-14T22:46:42.863 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66185.log 2024-09-14T22:46:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89448.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89448.log.gz 2024-09-14T22:46:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102326.log 2024-09-14T22:46:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66185.log.gz 2024-09-14T22:46:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121436.log 2024-09-14T22:46:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102326.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102326.log.gz 2024-09-14T22:46:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112661.log 2024-09-14T22:46:42.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121436.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121436.log.gz 2024-09-14T22:46:42.866 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40271.log 2024-09-14T22:46:42.867 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112661.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112661.log.gz 2024-09-14T22:46:42.867 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99646.log 2024-09-14T22:46:42.868 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40271.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.40271.log.gz --verbose 2024-09-14T22:46:42.868 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.mirror.140667.log 2024-09-14T22:46:42.869 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99646.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99646.log.gz 2024-09-14T22:46:42.869 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46725.log 2024-09-14T22:46:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140667.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140667.log.gz 2024-09-14T22:46:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135323.log 2024-09-14T22:46:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46725.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46725.log.gz 2024-09-14T22:46:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61964.log 2024-09-14T22:46:42.871 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135323.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135323.log.gz 2024-09-14T22:46:42.871 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151890.log 2024-09-14T22:46:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61964.log.gz 2024-09-14T22:46:42.872 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42032.log 2024-09-14T22:46:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151890.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151890.log.gz 2024-09-14T22:46:42.873 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148247.log 2024-09-14T22:46:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42032.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42032.log.gz 2024-09-14T22:46:42.874 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129217.log 2024-09-14T22:46:42.875 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148247.log.gz 2024-09-14T22:46:42.875 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103180.log 2024-09-14T22:46:42.875 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129217.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129217.log.gz 2024-09-14T22:46:42.876 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36694.log 2024-09-14T22:46:42.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103180.log.gz 2024-09-14T22:46:42.877 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103638.log 2024-09-14T22:46:42.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36694.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36694.log.gz 2024-09-14T22:46:42.877 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87477.log 2024-09-14T22:46:42.878 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103638.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103638.log.gz 2024-09-14T22:46:42.879 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36876.log 2024-09-14T22:46:42.879 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87477.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87477.log.gz 2024-09-14T22:46:42.879 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36180.log 2024-09-14T22:46:42.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36876.log.gz 2024-09-14T22:46:42.880 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135364.log 2024-09-14T22:46:42.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36180.log.gz 2024-09-14T22:46:42.880 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118202.log 2024-09-14T22:46:42.881 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135364.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135364.log.gz 2024-09-14T22:46:42.881 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149357.log 2024-09-14T22:46:42.882 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118202.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118202.log.gz 2024-09-14T22:46:42.882 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.44654.log 2024-09-14T22:46:42.882 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149357.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149357.log.gz 2024-09-14T22:46:42.882 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66742.log 2024-09-14T22:46:42.883 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.44654.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.44654.log.gz 2024-09-14T22:46:42.883 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83571.log 2024-09-14T22:46:42.884 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66742.log.gz 2024-09-14T22:46:42.884 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146481.log 2024-09-14T22:46:42.885 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83571.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83571.log.gz 2024-09-14T22:46:42.885 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139620.log 2024-09-14T22:46:42.886 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146481.log.gz 2024-09-14T22:46:42.886 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89909.log 2024-09-14T22:46:42.887 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139620.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139620.log.gz 2024-09-14T22:46:42.887 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52887.log 2024-09-14T22:46:42.887 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89909.log.gz 2024-09-14T22:46:42.887 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73803.log 2024-09-14T22:46:42.888 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52887.log.gz 2024-09-14T22:46:42.888 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88232.log 2024-09-14T22:46:42.889 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73803.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73803.log.gz 2024-09-14T22:46:42.889 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51187.log 2024-09-14T22:46:42.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88232.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88232.log.gz 2024-09-14T22:46:42.890 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130914.log 2024-09-14T22:46:42.891 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51187.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54211.log 2024-09-14T22:46:42.891 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51187.log.gz 2024-09-14T22:46:42.892 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130914.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130914.log.gz 2024-09-14T22:46:42.892 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87941.log 2024-09-14T22:46:42.892 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54211.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.54211.log.gz -5 2024-09-14T22:46:42.892 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.113545.log 2024-09-14T22:46:42.893 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87941.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87941.log.gz 2024-09-14T22:46:42.893 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41194.log 2024-09-14T22:46:42.894 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113545.log.gz 2024-09-14T22:46:42.894 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67742.log 2024-09-14T22:46:42.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41194.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41194.log.gz 2024-09-14T22:46:42.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78872.log 2024-09-14T22:46:42.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67742.log.gz 2024-09-14T22:46:42.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142562.log 2024-09-14T22:46:42.896 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78872.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78872.log.gz 2024-09-14T22:46:42.896 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125471.log 2024-09-14T22:46:42.897 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142562.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142562.log.gz 2024-09-14T22:46:42.897 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54733.log 2024-09-14T22:46:42.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125471.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125471.log.gz 2024-09-14T22:46:42.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85060.log 2024-09-14T22:46:42.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54733.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54733.log.gz 2024-09-14T22:46:42.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148984.log 2024-09-14T22:46:42.899 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85060.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85060.log.gz 2024-09-14T22:46:42.899 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45595.log 2024-09-14T22:46:42.900 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148984.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.148984.log.gz -5 2024-09-14T22:46:42.900 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.137636.log 2024-09-14T22:46:42.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45595.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45595.log.gz 2024-09-14T22:46:42.901 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124491.log 2024-09-14T22:46:42.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137636.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137636.log.gz 2024-09-14T22:46:42.902 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148667.log 2024-09-14T22:46:42.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124491.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124491.log.gz 2024-09-14T22:46:42.902 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136795.log 2024-09-14T22:46:42.903 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148667.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148667.log.gz 2024-09-14T22:46:42.903 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111488.log 2024-09-14T22:46:42.904 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136795.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136795.log.gz 2024-09-14T22:46:42.904 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103572.log 2024-09-14T22:46:42.905 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111488.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111488.log.gz 2024-09-14T22:46:42.905 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64481.log 2024-09-14T22:46:42.905 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103572.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103572.log.gz 2024-09-14T22:46:42.906 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35118.log 2024-09-14T22:46:42.906 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64481.log.gz 2024-09-14T22:46:42.907 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122887.log 2024-09-14T22:46:42.907 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35118.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35118.log.gz 2024-09-14T22:46:42.907 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67229.log 2024-09-14T22:46:42.908 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122887.log.gz 2024-09-14T22:46:42.908 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97863.log 2024-09-14T22:46:42.909 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67229.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67229.log.gz 2024-09-14T22:46:42.909 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133213.log 2024-09-14T22:46:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97863.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97863.log.gz 2024-09-14T22:46:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109026.log 2024-09-14T22:46:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133213.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133213.log.gz 2024-09-14T22:46:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107776.log 2024-09-14T22:46:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109026.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109026.log.gz 2024-09-14T22:46:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146126.log 2024-09-14T22:46:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107776.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107776.log.gz 2024-09-14T22:46:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79766.log 2024-09-14T22:46:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146126.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146126.log.gz 2024-09-14T22:46:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80618.log 2024-09-14T22:46:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79766.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79766.log.gz 2024-09-14T22:46:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39094.log 2024-09-14T22:46:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80618.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80618.log.gz 2024-09-14T22:46:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145681.log 2024-09-14T22:46:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39094.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39094.log.gz 2024-09-14T22:46:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148473.log 2024-09-14T22:46:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145681.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145681.log.gz 2024-09-14T22:46:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145940.log 2024-09-14T22:46:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148473.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148473.log.gz 2024-09-14T22:46:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43969.log 2024-09-14T22:46:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145940.log.gz 2024-09-14T22:46:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87418.log 2024-09-14T22:46:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43969.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.43969.log.gz -5 2024-09-14T22:46:42.918 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.108545.log 2024-09-14T22:46:42.919 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87418.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87418.log.gz 2024-09-14T22:46:42.919 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92305.log 2024-09-14T22:46:42.920 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108545.log.gz 2024-09-14T22:46:42.920 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104073.log 2024-09-14T22:46:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92305.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.71176.log 2024-09-14T22:46:42.921 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.92305.log.gz 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104073.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104073.log.gz 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111487.log 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71176.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.admin.71176.log.gz --verbose 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.37641.log 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111487.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111487.log.gz 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142009.log 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37641.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.37641.log.gz 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144719.log 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142009.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56091.log 2024-09-14T22:46:42.925 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142009.log.gz 2024-09-14T22:46:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144719.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.97823.log -- replaced with /var/log/ceph/cluster1-client.mirror.144719.log.gz 2024-09-14T22:46:42.926 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56091.log.gz 2024-09-14T22:46:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140164.log 2024-09-14T22:46:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97823.log.gz 2024-09-14T22:46:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100281.log 2024-09-14T22:46:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140164.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50621.log 2024-09-14T22:46:42.928 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140164.log.gz 2024-09-14T22:46:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100281.log.gz 2024-09-14T22:46:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60940.log 2024-09-14T22:46:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50621.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50621.log.gz 2024-09-14T22:46:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97484.log 2024-09-14T22:46:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60940.log.gz 2024-09-14T22:46:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76639.log 2024-09-14T22:46:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97484.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97484.log.gz 2024-09-14T22:46:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142237.log 2024-09-14T22:46:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76639.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.76639.log.gz -5 2024-09-14T22:46:42.932 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.80417.log 2024-09-14T22:46:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142237.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47985.log 2024-09-14T22:46:42.933 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142237.log.gz 2024-09-14T22:46:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80417.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80417.log.gz 2024-09-14T22:46:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85815.log 2024-09-14T22:46:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47985.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.108169.log 2024-09-14T22:46:42.934 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.47985.log.gz 2024-09-14T22:46:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85815.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.85815.log.gz -- 2024-09-14T22:46:42.935 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.88256.log 2024-09-14T22:46:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108169.log.gz 2024-09-14T22:46:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48576.log 2024-09-14T22:46:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88256.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88256.log.gz 2024-09-14T22:46:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38928.log 2024-09-14T22:46:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48576.log.gz 2024-09-14T22:46:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102020.log 2024-09-14T22:46:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38928.log.gz 2024-09-14T22:46:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131411.log 2024-09-14T22:46:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102020.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71837.log 2024-09-14T22:46:42.939 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102020.log.gz 2024-09-14T22:46:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131411.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131411.log.gz 2024-09-14T22:46:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46705.log 2024-09-14T22:46:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71837.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.71837.log.gz --verbose 2024-09-14T22:46:42.941 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.149043.log 2024-09-14T22:46:42.941 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46705.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster2-client.mirror.46705.log.gz -- 2024-09-14T22:46:42.941 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.72146.log 2024-09-14T22:46:42.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149043.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149043.log.gz 2024-09-14T22:46:42.942 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151801.log 2024-09-14T22:46:42.943 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72146.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134777.log 2024-09-14T22:46:42.943 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72146.log.gz 2024-09-14T22:46:42.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151801.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151801.log.gz 2024-09-14T22:46:42.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119317.log 2024-09-14T22:46:42.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134777.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134777.log.gz 2024-09-14T22:46:42.945 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130540.log 2024-09-14T22:46:42.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119317.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58496.log 2024-09-14T22:46:42.945 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119317.log.gz 2024-09-14T22:46:42.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130540.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130540.log.gz 2024-09-14T22:46:42.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95110.log 2024-09-14T22:46:42.947 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58496.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58496.log.gz 2024-09-14T22:46:42.947 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50767.log 2024-09-14T22:46:42.948 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95110.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137170.log 2024-09-14T22:46:42.949 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95110.log.gz 2024-09-14T22:46:42.949 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93782.log 2024-09-14T22:46:42.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50767.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50767.log.gz 2024-09-14T22:46:42.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137170.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137170.log.gz 2024-09-14T22:46:42.949 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132940.log 2024-09-14T22:46:42.950 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93782.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93782.log.gz 2024-09-14T22:46:42.950 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101309.log 2024-09-14T22:46:42.950 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132940.log.gzgzip 2024-09-14T22:46:42.951 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77669.log 2024-09-14T22:46:42.951 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101309.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.101309.log.gz /var/log/ceph/cluster1-client.mirror.89407.log 2024-09-14T22:46:42.951 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:42.952 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77669.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77669.log.gz 2024-09-14T22:46:42.952 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41446.log 2024-09-14T22:46:42.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89407.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.82182.log 2024-09-14T22:46:42.953 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.89407.log.gz 2024-09-14T22:46:42.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41446.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41446.log.gz 2024-09-14T22:46:42.954 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.120097.log 2024-09-14T22:46:42.954 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82182.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122597.log 2024-09-14T22:46:42.954 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82182.log.gz 2024-09-14T22:46:42.955 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.120097.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104261.log 2024-09-14T22:46:42.955 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.120097.log.gz 2024-09-14T22:46:42.956 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122597.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122597.log.gz 2024-09-14T22:46:42.956 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84067.log 2024-09-14T22:46:42.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104261.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104261.log.gz 2024-09-14T22:46:42.957 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56634.log 2024-09-14T22:46:42.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84067.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.84067.log.gz -5 --verbose 2024-09-14T22:46:42.957 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.mirror.106183.log 2024-09-14T22:46:42.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56634.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56634.log.gz 2024-09-14T22:46:42.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68183.log 2024-09-14T22:46:42.959 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106183.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106183.log.gz 2024-09-14T22:46:42.959 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128942.log 2024-09-14T22:46:42.960 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68183.log.gz 2024-09-14T22:46:42.960 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85772.log 2024-09-14T22:46:42.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128942.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128942.log.gz 2024-09-14T22:46:42.961 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72144.log 2024-09-14T22:46:42.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85772.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.85772.log.gz 2024-09-14T22:46:42.962 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60730.log 2024-09-14T22:46:42.962 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72144.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72144.log.gz 2024-09-14T22:46:42.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110350.log 2024-09-14T22:46:42.963 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60730.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60730.log.gz 2024-09-14T22:46:42.963 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90288.log 2024-09-14T22:46:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110350.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145703.log 2024-09-14T22:46:42.964 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110350.log.gz 2024-09-14T22:46:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90288.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90288.log.gz 2024-09-14T22:46:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94897.log 2024-09-14T22:46:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145703.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145703.log.gz 2024-09-14T22:46:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84355.log 2024-09-14T22:46:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94897.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79985.log 2024-09-14T22:46:42.966 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94897.log.gz 2024-09-14T22:46:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84355.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84355.log.gz 2024-09-14T22:46:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90168.log 2024-09-14T22:46:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79985.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79985.log.gz 2024-09-14T22:46:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48375.log 2024-09-14T22:46:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90168.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90168.log.gz 2024-09-14T22:46:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67786.log 2024-09-14T22:46:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48375.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48375.log.gz 2024-09-14T22:46:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118270.log 2024-09-14T22:46:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67786.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126384.log 2024-09-14T22:46:42.970 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67786.log.gz 2024-09-14T22:46:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118270.log.gz 2024-09-14T22:46:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53206.log 2024-09-14T22:46:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126384.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126384.log.gz 2024-09-14T22:46:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39135.log 2024-09-14T22:46:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53206.log.gz 2024-09-14T22:46:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.71077.log 2024-09-14T22:46:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39135.log.gz 2024-09-14T22:46:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83125.log 2024-09-14T22:46:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.71077.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.71077.log.gz 2024-09-14T22:46:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37159.log 2024-09-14T22:46:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83125.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83125.log.gz 2024-09-14T22:46:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46309.log 2024-09-14T22:46:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37159.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150489.log 2024-09-14T22:46:42.976 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37159.log.gz 2024-09-14T22:46:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46309.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46309.log.gz 2024-09-14T22:46:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127414.log 2024-09-14T22:46:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150489.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150489.log.gz 2024-09-14T22:46:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127745.log 2024-09-14T22:46:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127414.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127414.log.gz 2024-09-14T22:46:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99271.log 2024-09-14T22:46:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127745.log.gz 2024-09-14T22:46:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80308.log 2024-09-14T22:46:42.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99271.log.gz 2024-09-14T22:46:42.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116780.log 2024-09-14T22:46:42.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80308.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80308.log.gz 2024-09-14T22:46:42.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76029.log 2024-09-14T22:46:42.982 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116780.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116780.log.gz 2024-09-14T22:46:42.982 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115352.log 2024-09-14T22:46:42.982 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76029.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76029.log.gz 2024-09-14T22:46:42.983 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62338.log 2024-09-14T22:46:42.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115352.log.gz 2024-09-14T22:46:42.984 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109885.log 2024-09-14T22:46:42.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62338.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62338.log.gz 2024-09-14T22:46:42.984 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118296.log 2024-09-14T22:46:42.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109885.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109885.log.gz 2024-09-14T22:46:42.985 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65745.log 2024-09-14T22:46:42.985 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118296.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118296.log.gz 2024-09-14T22:46:42.985 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35956.log 2024-09-14T22:46:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65745.log.gz 2024-09-14T22:46:42.986 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120206.log 2024-09-14T22:46:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35956.log.gz 2024-09-14T22:46:42.987 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44335.log 2024-09-14T22:46:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120206.log.gz 2024-09-14T22:46:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41614.log 2024-09-14T22:46:42.988 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44335.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44335.log.gz 2024-09-14T22:46:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153982.log 2024-09-14T22:46:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41614.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41614.log.gz 2024-09-14T22:46:42.989 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39555.log 2024-09-14T22:46:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153982.log.gz 2024-09-14T22:46:42.990 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139982.log 2024-09-14T22:46:42.991 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39555.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39555.log.gz 2024-09-14T22:46:42.991 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79986.log 2024-09-14T22:46:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139982.log.gz 2024-09-14T22:46:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137045.log 2024-09-14T22:46:42.992 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79986.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79986.log.gz 2024-09-14T22:46:42.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139153.log 2024-09-14T22:46:42.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137045.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137045.log.gz 2024-09-14T22:46:42.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106089.log 2024-09-14T22:46:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139153.log.gz 2024-09-14T22:46:42.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139308.log 2024-09-14T22:46:42.995 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106089.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106089.log.gz 2024-09-14T22:46:42.995 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102719.log 2024-09-14T22:46:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139308.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139308.log.gz 2024-09-14T22:46:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138191.log 2024-09-14T22:46:42.996 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102719.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102719.log.gz 2024-09-14T22:46:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88734.log 2024-09-14T22:46:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138191.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138191.log.gz 2024-09-14T22:46:42.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147322.log 2024-09-14T22:46:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88734.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88734.log.gz 2024-09-14T22:46:42.998 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119248.log 2024-09-14T22:46:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147322.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147322.log.gz 2024-09-14T22:46:42.999 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57883.log 2024-09-14T22:46:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119248.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119248.log.gz 2024-09-14T22:46:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59761.log 2024-09-14T22:46:43.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57883.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57883.log.gz 2024-09-14T22:46:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147930.log 2024-09-14T22:46:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59761.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59761.log.gz 2024-09-14T22:46:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52030.log 2024-09-14T22:46:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147930.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147930.log.gz 2024-09-14T22:46:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40269.log 2024-09-14T22:46:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52030.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52030.log.gz 2024-09-14T22:46:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101075.log 2024-09-14T22:46:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40269.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40269.log.gz 2024-09-14T22:46:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.83006.log 2024-09-14T22:46:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101075.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101075.log.gz 2024-09-14T22:46:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45072.log 2024-09-14T22:46:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.83006.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.83006.log.gz 2024-09-14T22:46:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81560.log 2024-09-14T22:46:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45072.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45072.log.gz 2024-09-14T22:46:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150277.log 2024-09-14T22:46:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81560.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81560.log.gz 2024-09-14T22:46:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91792.log 2024-09-14T22:46:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150277.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150277.log.gz 2024-09-14T22:46:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101203.log 2024-09-14T22:46:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91792.log.gz 2024-09-14T22:46:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147363.log 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101203.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.101203.log.gz 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.91507.log 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147363.log.gz 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143033.log 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91507.log.gz 2024-09-14T22:46:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109992.log 2024-09-14T22:46:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143033.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143033.log.gz 2024-09-14T22:46:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123580.log 2024-09-14T22:46:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109992.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109992.log.gz 2024-09-14T22:46:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44771.log 2024-09-14T22:46:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123580.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123580.log.gz 2024-09-14T22:46:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90915.log 2024-09-14T22:46:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44771.log.gz 2024-09-14T22:46:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.35842.log 2024-09-14T22:46:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90915.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90915.log.gz 2024-09-14T22:46:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58428.log 2024-09-14T22:46:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.35842.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146881.log 2024-09-14T22:46:43.016 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.35842.log.gz 2024-09-14T22:46:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58428.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58428.log.gz 2024-09-14T22:46:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130673.log 2024-09-14T22:46:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146881.log.gz 2024-09-14T22:46:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107823.log 2024-09-14T22:46:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130673.log.gz 2024-09-14T22:46:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144902.log 2024-09-14T22:46:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107823.log.gz 2024-09-14T22:46:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62698.log 2024-09-14T22:46:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144902.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57975.log 2024-09-14T22:46:43.020 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144902.log.gz 2024-09-14T22:46:43.020 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62698.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62698.log.gz -5 2024-09-14T22:46:43.021 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.86887.log 2024-09-14T22:46:43.021 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57975.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57975.log.gz 2024-09-14T22:46:43.021 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124776.log 2024-09-14T22:46:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86887.log.gz 2024-09-14T22:46:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94120.log 2024-09-14T22:46:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124776.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119223.log 2024-09-14T22:46:43.023 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124776.log.gz 2024-09-14T22:46:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94120.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94120.log.gz 2024-09-14T22:46:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95921.log 2024-09-14T22:46:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119223.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119223.log.gz 2024-09-14T22:46:43.024 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70689.log 2024-09-14T22:46:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95921.log.gz 2024-09-14T22:46:43.025 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55869.log 2024-09-14T22:46:43.026 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70689.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.admin.70689.log.gz -- 2024-09-14T22:46:43.026 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.101117.log 2024-09-14T22:46:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55869.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55869.log.gz 2024-09-14T22:46:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46994.log 2024-09-14T22:46:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101117.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101117.log.gz 2024-09-14T22:46:43.027 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76323.log 2024-09-14T22:46:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46994.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46994.log.gz 2024-09-14T22:46:43.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75943.log 2024-09-14T22:46:43.029 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76323.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98241.log 2024-09-14T22:46:43.029 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76323.log.gz 2024-09-14T22:46:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75943.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75943.log.gz 2024-09-14T22:46:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107950.log 2024-09-14T22:46:43.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98241.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134905.log 2024-09-14T22:46:43.031 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98241.log.gz 2024-09-14T22:46:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107950.log.gz 2024-09-14T22:46:43.031 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117609.log 2024-09-14T22:46:43.032 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134905.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73363.log 2024-09-14T22:46:43.032 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134905.log.gz 2024-09-14T22:46:43.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117609.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57662.log 2024-09-14T22:46:43.033 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117609.log.gz 2024-09-14T22:46:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73363.log.gz 2024-09-14T22:46:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123329.log 2024-09-14T22:46:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57662.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57662.log.gz 2024-09-14T22:46:43.034 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54745.log 2024-09-14T22:46:43.035 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123329.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123329.log.gz 2024-09-14T22:46:43.035 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69861.log 2024-09-14T22:46:43.036 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54745.log.gz 2024-09-14T22:46:43.036 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.45737.log 2024-09-14T22:46:43.037 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69861.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69861.log.gz 2024-09-14T22:46:43.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72816.log 2024-09-14T22:46:43.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.45737.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.45737.log.gz 2024-09-14T22:46:43.038 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98459.log 2024-09-14T22:46:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72816.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72816.log.gz 2024-09-14T22:46:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111189.log 2024-09-14T22:46:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98459.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98459.log.gz 2024-09-14T22:46:43.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38714.log 2024-09-14T22:46:43.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111189.log.gz 2024-09-14T22:46:43.040 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77037.log 2024-09-14T22:46:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38714.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38714.log.gz 2024-09-14T22:46:43.041 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40645.log 2024-09-14T22:46:43.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77037.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.77037.log.gz 2024-09-14T22:46:43.042 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108440.log 2024-09-14T22:46:43.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40645.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40645.log.gz 2024-09-14T22:46:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141869.log 2024-09-14T22:46:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108440.log.gz 2024-09-14T22:46:43.043 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.33985.log 2024-09-14T22:46:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141869.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141869.log.gz 2024-09-14T22:46:43.044 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.128295.log 2024-09-14T22:46:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.33985.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.33985.log.gz 2024-09-14T22:46:43.045 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50306.log 2024-09-14T22:46:43.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.128295.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.128295.log.gz 2024-09-14T22:46:43.046 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125177.log 2024-09-14T22:46:43.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50306.log.gz 2024-09-14T22:46:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49571.log 2024-09-14T22:46:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125177.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125177.log.gz 2024-09-14T22:46:43.047 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52069.log 2024-09-14T22:46:43.048 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49571.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49571.log.gz 2024-09-14T22:46:43.048 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51061.log 2024-09-14T22:46:43.049 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52069.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52069.log.gz 2024-09-14T22:46:43.049 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110853.log 2024-09-14T22:46:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51061.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51061.log.gz 2024-09-14T22:46:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.60069.log 2024-09-14T22:46:43.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110853.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110853.log.gz 2024-09-14T22:46:43.051 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90035.log 2024-09-14T22:46:43.051 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.60069.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.60069.log.gz 2024-09-14T22:46:43.051 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93128.log 2024-09-14T22:46:43.052 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90035.log.gz 2024-09-14T22:46:43.052 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125786.log 2024-09-14T22:46:43.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93128.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93128.log.gz 2024-09-14T22:46:43.053 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107206.log 2024-09-14T22:46:43.054 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125786.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125786.log.gz 2024-09-14T22:46:43.054 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54570.log 2024-09-14T22:46:43.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107206.log.gz 2024-09-14T22:46:43.055 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97968.log 2024-09-14T22:46:43.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54570.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54570.log.gz 2024-09-14T22:46:43.055 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136502.log 2024-09-14T22:46:43.056 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97968.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97968.log.gz 2024-09-14T22:46:43.056 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103946.log 2024-09-14T22:46:43.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136502.log.gz 2024-09-14T22:46:43.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95424.log 2024-09-14T22:46:43.058 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103946.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103946.log.gz 2024-09-14T22:46:43.058 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57465.log 2024-09-14T22:46:43.059 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95424.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95424.log.gz 2024-09-14T22:46:43.059 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38335.log 2024-09-14T22:46:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57465.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57465.log.gz 2024-09-14T22:46:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105064.log 2024-09-14T22:46:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38335.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38335.log.gz 2024-09-14T22:46:43.060 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75653.log 2024-09-14T22:46:43.061 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105064.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105064.log.gz 2024-09-14T22:46:43.061 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117582.log 2024-09-14T22:46:43.062 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75653.log.gz 2024-09-14T22:46:43.062 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.46043.log 2024-09-14T22:46:43.063 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117582.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117582.log.gz 2024-09-14T22:46:43.063 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75383.log 2024-09-14T22:46:43.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.46043.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.46043.log.gz 2024-09-14T22:46:43.064 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100715.log 2024-09-14T22:46:43.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75383.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75383.log.gz 2024-09-14T22:46:43.065 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42161.log 2024-09-14T22:46:43.065 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100715.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100715.log.gz 2024-09-14T22:46:43.065 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36368.log 2024-09-14T22:46:43.066 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42161.log.gz 2024-09-14T22:46:43.066 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55873.log 2024-09-14T22:46:43.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36368.log.gz 2024-09-14T22:46:43.067 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109109.log 2024-09-14T22:46:43.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55873.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55873.log.gz 2024-09-14T22:46:43.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116736.log 2024-09-14T22:46:43.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109109.log.gz 2024-09-14T22:46:43.069 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113034.log 2024-09-14T22:46:43.069 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116736.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116736.log.gz 2024-09-14T22:46:43.069 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101144.log 2024-09-14T22:46:43.070 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113034.log.gz 2024-09-14T22:46:43.070 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43992.log 2024-09-14T22:46:43.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101144.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101144.log.gz 2024-09-14T22:46:43.071 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104752.log 2024-09-14T22:46:43.072 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43992.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43992.log.gz 2024-09-14T22:46:43.072 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61397.log 2024-09-14T22:46:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104752.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104752.log.gz 2024-09-14T22:46:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96471.log 2024-09-14T22:46:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61397.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61397.log.gz 2024-09-14T22:46:43.073 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147173.log 2024-09-14T22:46:43.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96471.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96471.log.gz 2024-09-14T22:46:43.074 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51609.log 2024-09-14T22:46:43.075 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147173.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147173.log.gz 2024-09-14T22:46:43.075 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125178.log 2024-09-14T22:46:43.076 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51609.log.gz 2024-09-14T22:46:43.076 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56274.log 2024-09-14T22:46:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125178.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125178.log.gz 2024-09-14T22:46:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116506.log 2024-09-14T22:46:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56274.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56274.log.gz 2024-09-14T22:46:43.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89827.log 2024-09-14T22:46:43.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116506.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116506.log.gz 2024-09-14T22:46:43.078 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76874.log 2024-09-14T22:46:43.079 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89827.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89827.log.gz 2024-09-14T22:46:43.079 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35050.log 2024-09-14T22:46:43.080 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76874.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76874.log.gz 2024-09-14T22:46:43.080 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.35999.log 2024-09-14T22:46:43.080 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35050.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35050.log.gz 2024-09-14T22:46:43.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53254.log 2024-09-14T22:46:43.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.35999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.35999.log.gz 2024-09-14T22:46:43.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96469.log 2024-09-14T22:46:43.082 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53254.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.53254.log.gz 2024-09-14T22:46:43.082 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.57602.log 2024-09-14T22:46:43.083 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96469.log.gz 2024-09-14T22:46:43.083 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.81404.log 2024-09-14T22:46:43.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57602.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57602.log.gz 2024-09-14T22:46:43.084 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145222.log 2024-09-14T22:46:43.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.81404.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.81404.log.gz 2024-09-14T22:46:43.085 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61502.log 2024-09-14T22:46:43.085 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145222.log.gz 2024-09-14T22:46:43.085 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88608.log 2024-09-14T22:46:43.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61502.log.gz 2024-09-14T22:46:43.086 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94991.log 2024-09-14T22:46:43.087 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88608.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88608.log.gz 2024-09-14T22:46:43.087 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80619.log 2024-09-14T22:46:43.088 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94991.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94991.log.gz 2024-09-14T22:46:43.088 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87942.log 2024-09-14T22:46:43.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80619.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80619.log.gz 2024-09-14T22:46:43.089 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98491.log 2024-09-14T22:46:43.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87942.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87942.log.gz 2024-09-14T22:46:43.089 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66395.log 2024-09-14T22:46:43.090 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98491.log.gzgzip 2024-09-14T22:46:43.090 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120995.log 2024-09-14T22:46:43.091 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66395.log.gz 2024-09-14T22:46:43.091 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54782.log 2024-09-14T22:46:43.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120995.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120995.log.gz 2024-09-14T22:46:43.092 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127282.log 2024-09-14T22:46:43.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54782.log.gz 2024-09-14T22:46:43.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133044.log 2024-09-14T22:46:43.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127282.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127282.log.gz 2024-09-14T22:46:43.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136546.log 2024-09-14T22:46:43.094 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133044.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133044.log.gz 2024-09-14T22:46:43.094 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.117767.log 2024-09-14T22:46:43.095 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136546.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136546.log.gz 2024-09-14T22:46:43.095 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.84483.log 2024-09-14T22:46:43.096 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.117767.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.117767.log.gz 2024-09-14T22:46:43.096 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103726.log 2024-09-14T22:46:43.097 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.84483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.84483.log.gz 2024-09-14T22:46:43.097 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99060.log 2024-09-14T22:46:43.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103726.log.gz 2024-09-14T22:46:43.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34999.log 2024-09-14T22:46:43.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99060.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99060.log.gz 2024-09-14T22:46:43.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102647.log 2024-09-14T22:46:43.099 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.34999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34999.log.gz 2024-09-14T22:46:43.099 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77959.log 2024-09-14T22:46:43.100 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102647.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102647.log.gz 2024-09-14T22:46:43.100 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43879.log 2024-09-14T22:46:43.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77959.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77959.log.gz 2024-09-14T22:46:43.101 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85124.log 2024-09-14T22:46:43.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43879.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43879.log.gz 2024-09-14T22:46:43.102 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134051.log 2024-09-14T22:46:43.102 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85124.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85124.log.gz 2024-09-14T22:46:43.102 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154303.log 2024-09-14T22:46:43.103 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134051.log.gz 2024-09-14T22:46:43.103 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152658.log 2024-09-14T22:46:43.104 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154303.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.154303.log.gz 2024-09-14T22:46:43.104 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37220.log 2024-09-14T22:46:43.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152658.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152658.log.gz 2024-09-14T22:46:43.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149273.log 2024-09-14T22:46:43.106 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37220.log.gz 2024-09-14T22:46:43.106 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73278.log 2024-09-14T22:46:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149273.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149273.log.gz 2024-09-14T22:46:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48857.log 2024-09-14T22:46:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73278.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73278.log.gz 2024-09-14T22:46:43.107 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93985.log 2024-09-14T22:46:43.108 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48857.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48857.log.gz 2024-09-14T22:46:43.108 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101665.log 2024-09-14T22:46:43.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93985.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93985.log.gz 2024-09-14T22:46:43.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85021.log 2024-09-14T22:46:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101665.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101665.log.gz 2024-09-14T22:46:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70662.log 2024-09-14T22:46:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85021.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85021.log.gz 2024-09-14T22:46:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112281.log 2024-09-14T22:46:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70662.log.gz 2024-09-14T22:46:43.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49218.log 2024-09-14T22:46:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112281.log.gz 2024-09-14T22:46:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57331.log 2024-09-14T22:46:43.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49218.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49218.log.gz 2024-09-14T22:46:43.113 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95619.log 2024-09-14T22:46:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57331.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57331.log.gz 2024-09-14T22:46:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85833.log 2024-09-14T22:46:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95619.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95619.log.gz 2024-09-14T22:46:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146587.log 2024-09-14T22:46:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85833.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85833.log.gz 2024-09-14T22:46:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87600.log 2024-09-14T22:46:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146587.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146587.log.gz 2024-09-14T22:46:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.33909.log 2024-09-14T22:46:43.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87600.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87600.log.gz 2024-09-14T22:46:43.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70031.log 2024-09-14T22:46:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.33909.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.33909.log.gz 2024-09-14T22:46:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121820.log 2024-09-14T22:46:43.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70031.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70031.log.gz 2024-09-14T22:46:43.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89323.log 2024-09-14T22:46:43.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121820.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121820.log.gz 2024-09-14T22:46:43.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50431.log 2024-09-14T22:46:43.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89323.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89323.log.gz 2024-09-14T22:46:43.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112744.log 2024-09-14T22:46:43.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50431.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50431.log.gz 2024-09-14T22:46:43.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66094.log 2024-09-14T22:46:43.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112744.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112744.log.gz 2024-09-14T22:46:43.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74071.log 2024-09-14T22:46:43.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66094.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66094.log.gz 2024-09-14T22:46:43.123 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98299.log 2024-09-14T22:46:43.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74071.log.gz 2024-09-14T22:46:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106727.log 2024-09-14T22:46:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98299.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98299.log.gz 2024-09-14T22:46:43.124 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63339.log 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106727.log.gz 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87940.log 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63339.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63339.log.gz 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40965.log 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87940.log.gz 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109615.log 2024-09-14T22:46:43.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40965.log.gz 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96130.log 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109615.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109615.log.gz 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66081.log 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96130.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96130.log.gz 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146353.log 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66081.log.gz 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84705.log 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146353.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146353.log.gz 2024-09-14T22:46:43.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139038.log 2024-09-14T22:46:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84705.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84705.log.gz 2024-09-14T22:46:43.133 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62848.log 2024-09-14T22:46:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139038.log.gz 2024-09-14T22:46:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115330.log 2024-09-14T22:46:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62848.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62848.log.gz 2024-09-14T22:46:43.134 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65766.log 2024-09-14T22:46:43.135 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115330.log.gz 2024-09-14T22:46:43.135 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107692.log 2024-09-14T22:46:43.135 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65766.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.65766.log.gz 2024-09-14T22:46:43.135 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147885.log 2024-09-14T22:46:43.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107692.log.gz 2024-09-14T22:46:43.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121862.log 2024-09-14T22:46:43.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147885.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140864.log 2024-09-14T22:46:43.137 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147885.log.gz 2024-09-14T22:46:43.137 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121862.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121862.log.gz 2024-09-14T22:46:43.137 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83370.log 2024-09-14T22:46:43.138 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140864.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140864.log.gz 2024-09-14T22:46:43.138 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66227.log 2024-09-14T22:46:43.139 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83370.log.gz 2024-09-14T22:46:43.139 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68519.log 2024-09-14T22:46:43.140 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66227.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66227.log.gz 2024-09-14T22:46:43.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141956.log 2024-09-14T22:46:43.141 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68519.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68519.log.gz 2024-09-14T22:46:43.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38883.log 2024-09-14T22:46:43.141 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141956.log.gz 2024-09-14T22:46:43.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111065.log 2024-09-14T22:46:43.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38883.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38883.log.gz 2024-09-14T22:46:43.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58583.log 2024-09-14T22:46:43.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111065.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111065.log.gz 2024-09-14T22:46:43.143 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92804.log 2024-09-14T22:46:43.144 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58583.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58583.log.gz 2024-09-14T22:46:43.144 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142143.log 2024-09-14T22:46:43.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92804.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92804.log.gz 2024-09-14T22:46:43.145 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35754.log 2024-09-14T22:46:43.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142143.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142143.log.gz 2024-09-14T22:46:43.146 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70414.log 2024-09-14T22:46:43.146 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35754.log.gz 2024-09-14T22:46:43.146 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101495.log 2024-09-14T22:46:43.147 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70414.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70414.log.gz 2024-09-14T22:46:43.147 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121415.log 2024-09-14T22:46:43.148 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101495.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101495.log.gz 2024-09-14T22:46:43.148 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146252.log 2024-09-14T22:46:43.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121415.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121415.log.gz 2024-09-14T22:46:43.149 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106411.log 2024-09-14T22:46:43.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146252.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125222.log 2024-09-14T22:46:43.149 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146252.log.gz 2024-09-14T22:46:43.150 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106411.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106411.log.gz 2024-09-14T22:46:43.150 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111973.log 2024-09-14T22:46:43.151 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125222.log.gz 2024-09-14T22:46:43.151 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143821.log 2024-09-14T22:46:43.152 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111973.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111973.log.gz 2024-09-14T22:46:43.152 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45112.log 2024-09-14T22:46:43.153 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143821.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143821.log.gz 2024-09-14T22:46:43.153 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67228.log 2024-09-14T22:46:43.153 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45112.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45112.log.gz 2024-09-14T22:46:43.153 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86298.log 2024-09-14T22:46:43.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67228.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67228.log.gz 2024-09-14T22:46:43.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107122.log 2024-09-14T22:46:43.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86298.log.gz 2024-09-14T22:46:43.155 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110280.log 2024-09-14T22:46:43.156 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107122.log.gz 2024-09-14T22:46:43.156 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69008.log 2024-09-14T22:46:43.157 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110280.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110280.log.gz 2024-09-14T22:46:43.157 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118524.log 2024-09-14T22:46:43.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69008.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69008.log.gz 2024-09-14T22:46:43.158 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110263.log 2024-09-14T22:46:43.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118524.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118524.log.gz 2024-09-14T22:46:43.158 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83525.log 2024-09-14T22:46:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110263.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.110263.log.gz 2024-09-14T22:46:43.159 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.54379.log 2024-09-14T22:46:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83525.log.gz 2024-09-14T22:46:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132812.log 2024-09-14T22:46:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54379.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54379.log.gz 2024-09-14T22:46:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104953.log 2024-09-14T22:46:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132812.log.gz 2024-09-14T22:46:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118612.log 2024-09-14T22:46:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104953.log.gz 2024-09-14T22:46:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121206.log 2024-09-14T22:46:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118612.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118612.log.gz 2024-09-14T22:46:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112833.log 2024-09-14T22:46:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121206.log.gz 2024-09-14T22:46:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140270.log 2024-09-14T22:46:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112833.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112833.log.gz 2024-09-14T22:46:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54339.log 2024-09-14T22:46:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140270.log.gz 2024-09-14T22:46:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67567.log 2024-09-14T22:46:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54339.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54339.log.gz 2024-09-14T22:46:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146921.log 2024-09-14T22:46:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67567.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67567.log.gz 2024-09-14T22:46:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125892.log 2024-09-14T22:46:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146921.log.gz 2024-09-14T22:46:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105232.log 2024-09-14T22:46:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125892.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125892.log.gz 2024-09-14T22:46:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52279.log 2024-09-14T22:46:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105232.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105232.log.gz 2024-09-14T22:46:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145852.log 2024-09-14T22:46:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52279.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52279.log.gz 2024-09-14T22:46:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37115.log 2024-09-14T22:46:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145852.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145852.log.gz 2024-09-14T22:46:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105506.log 2024-09-14T22:46:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37115.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37115.log.gz 2024-09-14T22:46:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127095.log 2024-09-14T22:46:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105506.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105506.log.gz 2024-09-14T22:46:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117787.log 2024-09-14T22:46:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127095.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127095.log.gz 2024-09-14T22:46:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126523.log 2024-09-14T22:46:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117787.log.gz 2024-09-14T22:46:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74815.log 2024-09-14T22:46:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126523.log.gz 2024-09-14T22:46:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138493.log 2024-09-14T22:46:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74815.log.gz 2024-09-14T22:46:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140380.log 2024-09-14T22:46:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138493.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138493.log.gz 2024-09-14T22:46:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123013.log 2024-09-14T22:46:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140380.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140380.log.gz 2024-09-14T22:46:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90676.log 2024-09-14T22:46:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123013.log.gz 2024-09-14T22:46:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35893.log 2024-09-14T22:46:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90676.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90676.log.gz 2024-09-14T22:46:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89195.log 2024-09-14T22:46:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35893.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35893.log.gz 2024-09-14T22:46:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65618.log 2024-09-14T22:46:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89195.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89195.log.gz 2024-09-14T22:46:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60939.log 2024-09-14T22:46:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65618.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65618.log.gz 2024-09-14T22:46:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87180.log 2024-09-14T22:46:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60939.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60939.log.gz 2024-09-14T22:46:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109321.log 2024-09-14T22:46:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87180.log.gz 2024-09-14T22:46:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54171.log 2024-09-14T22:46:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109321.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109321.log.gz 2024-09-14T22:46:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65241.log 2024-09-14T22:46:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54171.log.gz 2024-09-14T22:46:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106203.log 2024-09-14T22:46:43.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65241.log.gz 2024-09-14T22:46:43.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93601.log 2024-09-14T22:46:43.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106203.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106203.log.gz 2024-09-14T22:46:43.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60441.log 2024-09-14T22:46:43.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93601.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93601.log.gz 2024-09-14T22:46:43.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51316.log 2024-09-14T22:46:43.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60441.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60441.log.gz 2024-09-14T22:46:43.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99437.log 2024-09-14T22:46:43.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51316.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51316.log.gz 2024-09-14T22:46:43.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81758.log 2024-09-14T22:46:43.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99437.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99437.log.gz 2024-09-14T22:46:43.190 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135638.log 2024-09-14T22:46:43.191 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81758.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81758.log.gz 2024-09-14T22:46:43.191 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36873.log 2024-09-14T22:46:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135638.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135638.log.gz 2024-09-14T22:46:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122740.log 2024-09-14T22:46:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36873.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36873.log.gz 2024-09-14T22:46:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125051.log 2024-09-14T22:46:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122740.log.gz 2024-09-14T22:46:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90164.log 2024-09-14T22:46:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125051.log.gz 2024-09-14T22:46:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75167.log 2024-09-14T22:46:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90164.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90164.log.gz 2024-09-14T22:46:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72271.log 2024-09-14T22:46:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75167.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75167.log.gz 2024-09-14T22:46:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106986.log 2024-09-14T22:46:43.197 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72271.log.gz 2024-09-14T22:46:43.197 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73631.log 2024-09-14T22:46:43.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106986.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106986.log.gz 2024-09-14T22:46:43.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150210.log 2024-09-14T22:46:43.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73631.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73631.log.gz 2024-09-14T22:46:43.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58952.log 2024-09-14T22:46:43.199 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150210.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150210.log.gz 2024-09-14T22:46:43.199 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142412.log 2024-09-14T22:46:43.200 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58952.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58952.log.gz 2024-09-14T22:46:43.200 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121501.log 2024-09-14T22:46:43.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142412.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142412.log.gz 2024-09-14T22:46:43.201 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127326.log 2024-09-14T22:46:43.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121501.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121501.log.gz 2024-09-14T22:46:43.202 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60791.log 2024-09-14T22:46:43.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127326.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127326.log.gz 2024-09-14T22:46:43.202 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44516.log 2024-09-14T22:46:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60791.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60791.log.gz 2024-09-14T22:46:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112913.log 2024-09-14T22:46:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44516.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44516.log.gz 2024-09-14T22:46:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83307.log 2024-09-14T22:46:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112913.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112913.log.gz 2024-09-14T22:46:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56957.log 2024-09-14T22:46:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83307.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83307.log.gz 2024-09-14T22:46:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105657.log 2024-09-14T22:46:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56957.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56957.log.gz 2024-09-14T22:46:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89828.log 2024-09-14T22:46:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105657.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105657.log.gz 2024-09-14T22:46:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41737.log 2024-09-14T22:46:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89828.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89828.log.gz 2024-09-14T22:46:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107914.log 2024-09-14T22:46:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41737.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41737.log.gz 2024-09-14T22:46:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121376.log 2024-09-14T22:46:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107914.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107914.log.gz 2024-09-14T22:46:43.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43091.log 2024-09-14T22:46:43.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121376.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121376.log.gz 2024-09-14T22:46:43.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79604.log 2024-09-14T22:46:43.211 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43091.log.gz 2024-09-14T22:46:43.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120850.log 2024-09-14T22:46:43.212 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79604.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79604.log.gz 2024-09-14T22:46:43.212 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136105.log 2024-09-14T22:46:43.213 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120850.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120850.log.gz 2024-09-14T22:46:43.213 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65239.log 2024-09-14T22:46:43.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136105.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136105.log.gz 2024-09-14T22:46:43.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145892.log 2024-09-14T22:46:43.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65239.log.gz 2024-09-14T22:46:43.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44909.log 2024-09-14T22:46:43.215 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145892.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145892.log.gz 2024-09-14T22:46:43.215 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144654.log 2024-09-14T22:46:43.216 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44909.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44909.log.gz 2024-09-14T22:46:43.216 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56220.log 2024-09-14T22:46:43.217 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144654.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144654.log.gz 2024-09-14T22:46:43.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149507.log 2024-09-14T22:46:43.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56220.log.gz 2024-09-14T22:46:43.218 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36877.log 2024-09-14T22:46:43.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149507.log.gz 2024-09-14T22:46:43.219 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85606.log 2024-09-14T22:46:43.219 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36877.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36877.log.gz 2024-09-14T22:46:43.220 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152099.log 2024-09-14T22:46:43.220 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85606.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85606.log.gz 2024-09-14T22:46:43.220 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48096.log 2024-09-14T22:46:43.221 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152099.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.152099.log.gz 2024-09-14T22:46:43.221 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51821.log 2024-09-14T22:46:43.222 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48096.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48096.log.gz 2024-09-14T22:46:43.222 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139891.log 2024-09-14T22:46:43.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51821.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51821.log.gz 2024-09-14T22:46:43.223 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121903.log 2024-09-14T22:46:43.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139891.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139891.log.gz 2024-09-14T22:46:43.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141842.log 2024-09-14T22:46:43.224 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121903.log.gz 2024-09-14T22:46:43.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67045.log 2024-09-14T22:46:43.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141842.log.gz 2024-09-14T22:46:43.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140572.log 2024-09-14T22:46:43.226 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67045.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67045.log.gz 2024-09-14T22:46:43.226 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135385.log 2024-09-14T22:46:43.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140572.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140572.log.gz 2024-09-14T22:46:43.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111356.log 2024-09-14T22:46:43.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135385.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135385.log.gz 2024-09-14T22:46:43.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99212.log 2024-09-14T22:46:43.228 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111356.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111356.log.gz 2024-09-14T22:46:43.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83441.log 2024-09-14T22:46:43.229 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99212.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99212.log.gz 2024-09-14T22:46:43.229 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50011.log 2024-09-14T22:46:43.230 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83441.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83441.log.gz 2024-09-14T22:46:43.230 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40775.log 2024-09-14T22:46:43.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50011.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50011.log.gz 2024-09-14T22:46:43.231 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125470.log 2024-09-14T22:46:43.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40775.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40775.log.gz 2024-09-14T22:46:43.232 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51483.log 2024-09-14T22:46:43.232 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125470.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125470.log.gz 2024-09-14T22:46:43.232 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67522.log 2024-09-14T22:46:43.233 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51483.log.gz 2024-09-14T22:46:43.233 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86068.log 2024-09-14T22:46:43.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67522.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67522.log.gz 2024-09-14T22:46:43.234 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129342.log 2024-09-14T22:46:43.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86068.log.gz 2024-09-14T22:46:43.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45400.log 2024-09-14T22:46:43.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129342.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129342.log.gz 2024-09-14T22:46:43.236 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53079.log 2024-09-14T22:46:43.236 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45400.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45400.log.gz 2024-09-14T22:46:43.236 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122950.log 2024-09-14T22:46:43.237 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53079.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53079.log.gz 2024-09-14T22:46:43.237 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151343.log 2024-09-14T22:46:43.238 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122950.log.gz 2024-09-14T22:46:43.238 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42927.log 2024-09-14T22:46:43.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151343.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151343.log.gz 2024-09-14T22:46:43.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62129.log 2024-09-14T22:46:43.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42927.log.gz 2024-09-14T22:46:43.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89867.log 2024-09-14T22:46:43.240 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62129.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62129.log.gz 2024-09-14T22:46:43.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134262.log 2024-09-14T22:46:43.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89867.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89867.log.gz 2024-09-14T22:46:43.241 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68626.log 2024-09-14T22:46:43.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134262.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134262.log.gz 2024-09-14T22:46:43.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118498.log 2024-09-14T22:46:43.243 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68626.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68626.log.gz 2024-09-14T22:46:43.243 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38293.log 2024-09-14T22:46:43.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118498.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118498.log.gz 2024-09-14T22:46:43.244 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151626.log 2024-09-14T22:46:43.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38293.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38293.log.gz 2024-09-14T22:46:43.244 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86821.log 2024-09-14T22:46:43.245 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151626.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151626.log.gz 2024-09-14T22:46:43.245 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.56885.log 2024-09-14T22:46:43.246 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86821.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86821.log.gz 2024-09-14T22:46:43.246 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87875.log 2024-09-14T22:46:43.247 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56885.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56885.log.gz 2024-09-14T22:46:43.247 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69554.log 2024-09-14T22:46:43.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87875.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87875.log.gz 2024-09-14T22:46:43.248 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94234.log 2024-09-14T22:46:43.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69554.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.69554.log.gz 2024-09-14T22:46:43.249 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.55532.log 2024-09-14T22:46:43.249 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94234.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94234.log.gz 2024-09-14T22:46:43.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120576.log 2024-09-14T22:46:43.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55532.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55532.log.gz 2024-09-14T22:46:43.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118752.log 2024-09-14T22:46:43.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120576.log.gz 2024-09-14T22:46:43.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136329.log 2024-09-14T22:46:43.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118752.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118752.log.gz 2024-09-14T22:46:43.252 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39846.log 2024-09-14T22:46:43.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136329.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136329.log.gz 2024-09-14T22:46:43.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123370.log 2024-09-14T22:46:43.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39846.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39846.log.gz 2024-09-14T22:46:43.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55127.log 2024-09-14T22:46:43.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123370.log.gz 2024-09-14T22:46:43.256 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86382.log 2024-09-14T22:46:43.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55127.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55127.log.gz 2024-09-14T22:46:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78797.log 2024-09-14T22:46:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86382.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86382.log.gz 2024-09-14T22:46:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147827.log 2024-09-14T22:46:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78797.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78797.log.gz 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74642.log 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147827.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.147827.log.gz -- 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster2-client.admin.57311.log 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74642.log.gz 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50979.log 2024-09-14T22:46:43.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57311.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.57311.log.gz -5 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.110371.log 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50979.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50979.log.gz 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.68395.log 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110371.log.gz 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71840.log 2024-09-14T22:46:43.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.68395.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.68395.log.gz 2024-09-14T22:46:43.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141614.log 2024-09-14T22:46:43.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71840.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71840.log.gz 2024-09-14T22:46:43.288 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147599.log 2024-09-14T22:46:43.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141614.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141614.log.gz 2024-09-14T22:46:43.288 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121101.log 2024-09-14T22:46:43.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147599.log.gz 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115081.log 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121101.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121101.log.gz 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38967.log 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115081.log.gz 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73866.log 2024-09-14T22:46:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38967.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38967.log.gz 2024-09-14T22:46:43.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43301.log 2024-09-14T22:46:43.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73866.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73866.log.gz 2024-09-14T22:46:43.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48795.log 2024-09-14T22:46:43.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43301.log.gz 2024-09-14T22:46:43.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153153.log 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48795.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48795.log.gz 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137589.log 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153153.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153153.log.gz 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93220.log 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137589.log.gz 2024-09-14T22:46:43.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120996.log 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93220.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93220.log.gz 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44334.log 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120996.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120996.log.gz 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150881.log 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44334.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44334.log.gz 2024-09-14T22:46:43.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40690.log 2024-09-14T22:46:43.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150881.log.gz 2024-09-14T22:46:43.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140054.log 2024-09-14T22:46:43.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40690.log.gz 2024-09-14T22:46:43.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66225.log 2024-09-14T22:46:43.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140054.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140054.log.gz 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128836.log 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66225.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66225.log.gz 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114612.log 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128836.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128836.log.gz 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67823.log 2024-09-14T22:46:43.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114612.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114612.log.gz 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41025.log 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67823.log.gz 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72964.log 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41025.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41025.log.gz 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113877.log 2024-09-14T22:46:43.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72964.log.gz 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48755.log 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113877.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113877.log.gz 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114007.log 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48755.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48755.log.gz 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142506.log 2024-09-14T22:46:43.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114007.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114007.log.gz 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117042.log 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142506.log.gz 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56553.log 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117042.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117042.log.gz 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89110.log 2024-09-14T22:46:43.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56553.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56553.log.gz 2024-09-14T22:46:43.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68951.log 2024-09-14T22:46:43.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89110.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89110.log.gz 2024-09-14T22:46:43.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117504.log 2024-09-14T22:46:43.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68951.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68951.log.gz 2024-09-14T22:46:43.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78760.log 2024-09-14T22:46:43.299 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117504.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117504.log.gz 2024-09-14T22:46:43.299 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131695.log 2024-09-14T22:46:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78760.log.gz 2024-09-14T22:46:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.34688.log 2024-09-14T22:46:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131695.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131695.log.gz 2024-09-14T22:46:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153371.log 2024-09-14T22:46:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.34688.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.34688.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69874.log 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153371.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153371.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38126.log 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69874.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69874.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57443.log 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38126.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38126.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151799.log 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57443.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57443.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41106.log 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151799.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151799.log.gz 2024-09-14T22:46:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138517.log 2024-09-14T22:46:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41106.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41106.log.gz 2024-09-14T22:46:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61584.log 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138517.log.gz 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84808.log 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61584.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61584.log.gz 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153526.log 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84808.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84808.log.gz 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145234.log 2024-09-14T22:46:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153526.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153526.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120704.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145234.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145234.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62028.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120704.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120704.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70715.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62028.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62028.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55651.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70715.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70715.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124147.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55651.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55651.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.129856.log 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124147.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124147.log.gz 2024-09-14T22:46:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145390.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.129856.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.129856.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105711.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145390.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145390.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.67018.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105711.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105711.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.129742.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.67018.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.67018.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142584.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.129742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.129742.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89910.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142584.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142584.log.gz 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88481.log 2024-09-14T22:46:43.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89910.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89910.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118849.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88481.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119318.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118849.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118849.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101159.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119318.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119318.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62216.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101159.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101159.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119139.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62216.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62216.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59189.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119139.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119139.log.gz 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45402.log 2024-09-14T22:46:43.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59189.log.gz 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101832.log 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45402.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45402.log.gz 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116967.log 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101832.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101832.log.gz 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48247.log 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116967.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116967.log.gz 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58469.log 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48247.log.gz 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112493.log 2024-09-14T22:46:43.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58469.log.gz 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134137.log 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112493.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112493.log.gz 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105098.log 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134137.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134137.log.gz 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139647.log 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105098.log.gz 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108693.log 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139647.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139647.log.gz 2024-09-14T22:46:43.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74121.log 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108693.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108693.log.gz 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120575.log 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74121.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74121.log.gz 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40355.log 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120575.log.gz 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150991.log 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40355.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40355.log.gz 2024-09-14T22:46:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78796.log 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150991.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150991.log.gz 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78023.log 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78796.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78796.log.gz 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79721.log 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78023.log.gz 2024-09-14T22:46:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88923.log 2024-09-14T22:46:43.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79721.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79721.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90369.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88923.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88923.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141283.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90369.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110160.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141283.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141283.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43423.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110160.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110160.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79633.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43423.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43475.log 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79633.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79633.log.gz 2024-09-14T22:46:43.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71098.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43475.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43475.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154617.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71098.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.154096.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154617.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154617.log.gz -5 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.38043.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.154096.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.154096.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148140.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38043.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38043.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139261.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148140.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148140.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150143.log 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139261.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139261.log.gz 2024-09-14T22:46:43.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134944.log 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150143.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150143.log.gz 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51945.log 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134944.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134944.log.gz 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145514.log 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51945.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.35204.log 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51945.log.gz 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145514.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145514.log.gz 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56092.log 2024-09-14T22:46:43.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.35204.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.35204.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41589.log 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56092.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56092.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145516.log 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41589.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131611.log 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145516.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145516.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97590.log 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131611.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94576.log 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131611.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97590.log.gz 2024-09-14T22:46:43.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113372.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94576.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72755.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113372.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113372.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70279.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72755.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126358.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72755.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70279.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70279.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100534.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126358.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142899.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100534.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.100534.log.gz -5 --verbose 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.36656.log 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142899.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142899.log.gz 2024-09-14T22:46:43.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61150.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36656.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36656.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101537.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61150.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61150.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89028.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101537.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101537.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112218.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89028.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89028.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96942.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112218.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112218.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138335.log 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96942.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96942.log.gz 2024-09-14T22:46:43.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.92499.log 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138335.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138335.log.gz 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86886.log 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.92499.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.92499.log.gz 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113646.log 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86886.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86886.log.gz 2024-09-14T22:46:43.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129107.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113646.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113646.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62446.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129107.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102956.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129107.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62446.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62446.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145620.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102956.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38253.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145620.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145620.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92623.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38253.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83477.log 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38253.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92623.log.gz 2024-09-14T22:46:43.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121647.log 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83477.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83477.log.gz 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58221.log 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121647.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121647.log.gz 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73613.log 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58221.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.95662.log 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.58221.log.gz 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73613.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73613.log.gz 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126494.log 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95662.log.gz 2024-09-14T22:46:43.371 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123241.log 2024-09-14T22:46:43.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126494.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126494.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47135.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123241.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112829.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47135.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149251.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112829.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112829.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97738.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149251.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149251.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112364.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97738.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97738.log.gz 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127744.log 2024-09-14T22:46:43.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112364.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112364.log.gz 2024-09-14T22:46:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90617.log 2024-09-14T22:46:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127744.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127744.log.gz 2024-09-14T22:46:43.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105407.log 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90617.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90617.log.gz 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127371.log 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105407.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105407.log.gz -5 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.113455.log 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127371.log.gz 2024-09-14T22:46:43.379 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57665.log 2024-09-14T22:46:43.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113455.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113455.log.gz 2024-09-14T22:46:43.380 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115682.log 2024-09-14T22:46:43.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57665.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57665.log.gz 2024-09-14T22:46:43.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127796.log 2024-09-14T22:46:43.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115682.log.gz 2024-09-14T22:46:43.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117974.log 2024-09-14T22:46:43.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127796.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127796.log.gz 2024-09-14T22:46:43.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55423.log 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117974.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117974.log.gz 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152890.log 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55423.log.gz 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116149.log 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152890.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152890.log.gz 2024-09-14T22:46:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.46069.log 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116149.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.116149.log.gz 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144398.log 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.46069.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.46069.log.gz 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77628.log 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144398.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144398.log.gz 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106867.log 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77628.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77628.log.gz 2024-09-14T22:46:43.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44942.log 2024-09-14T22:46:43.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106867.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106867.log.gz 2024-09-14T22:46:43.388 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51901.log 2024-09-14T22:46:43.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44942.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44942.log.gz 2024-09-14T22:46:43.388 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124903.log 2024-09-14T22:46:43.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51901.log.gz 2024-09-14T22:46:43.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59916.log 2024-09-14T22:46:43.390 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124903.log.gz 2024-09-14T22:46:43.390 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130385.log 2024-09-14T22:46:43.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59916.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59916.log.gz 2024-09-14T22:46:43.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123749.log 2024-09-14T22:46:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130385.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130385.log.gz 2024-09-14T22:46:43.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92176.log 2024-09-14T22:46:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123749.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123749.log.gz 2024-09-14T22:46:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79067.log 2024-09-14T22:46:43.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92176.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92176.log.gz -5 2024-09-14T22:46:43.393 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.101959.log 2024-09-14T22:46:43.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79067.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79067.log.gz 2024-09-14T22:46:43.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48184.log 2024-09-14T22:46:43.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101959.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101959.log.gz 2024-09-14T22:46:43.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91795.log 2024-09-14T22:46:43.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48184.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48184.log.gz 2024-09-14T22:46:43.397 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84706.log 2024-09-14T22:46:43.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91795.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91795.log.gz 2024-09-14T22:46:43.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41385.log 2024-09-14T22:46:43.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84706.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84706.log.gz 2024-09-14T22:46:43.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88145.log 2024-09-14T22:46:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41385.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41385.log.gz 2024-09-14T22:46:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133441.log 2024-09-14T22:46:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88145.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88145.log.gz 2024-09-14T22:46:43.400 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78339.log 2024-09-14T22:46:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133441.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133441.log.gz 2024-09-14T22:46:43.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153619.log 2024-09-14T22:46:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78339.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78339.log.gz 2024-09-14T22:46:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54779.log 2024-09-14T22:46:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153619.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153619.log.gz 2024-09-14T22:46:43.403 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100257.log 2024-09-14T22:46:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54779.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54779.log.gz 2024-09-14T22:46:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49217.log 2024-09-14T22:46:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100257.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100257.log.gz 2024-09-14T22:46:43.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64001.log 2024-09-14T22:46:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49217.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49217.log.gz 2024-09-14T22:46:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118015.log 2024-09-14T22:46:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64001.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64001.log.gz 2024-09-14T22:46:43.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147571.log 2024-09-14T22:46:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118015.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118015.log.gz 2024-09-14T22:46:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118451.log 2024-09-14T22:46:43.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147571.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.147571.log.gz 2024-09-14T22:46:43.407 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.78730.log 2024-09-14T22:46:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118451.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118451.log.gz 2024-09-14T22:46:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71227.log 2024-09-14T22:46:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78730.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78730.log.gz 2024-09-14T22:46:43.408 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74726.log 2024-09-14T22:46:43.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71227.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126989.log 2024-09-14T22:46:43.410 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71227.log.gz 2024-09-14T22:46:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74726.log.gz 2024-09-14T22:46:43.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63331.log 2024-09-14T22:46:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126989.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126989.log.gz 2024-09-14T22:46:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76452.log 2024-09-14T22:46:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63331.log.gz 2024-09-14T22:46:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50642.log 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76452.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76452.log.gz 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83914.log 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50642.log.gz 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106271.log 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83914.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83914.log.gz 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132545.log 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106271.log.gz 2024-09-14T22:46:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74181.log 2024-09-14T22:46:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132545.log.gz 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154075.log 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74181.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74181.log.gz 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119507.log 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154075.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.154075.log.gz 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42841.log 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119507.log.gz 2024-09-14T22:46:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70963.log 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42841.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42841.log.gz 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37219.log 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70963.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70963.log.gz 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149145.log 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37219.log.gz 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56090.log 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149145.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78340.log 2024-09-14T22:46:43.421 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149145.log.gz 2024-09-14T22:46:43.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56090.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56090.log.gz 2024-09-14T22:46:43.422 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41905.log 2024-09-14T22:46:43.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78340.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146545.log 0.0% 2024-09-14T22:46:43.423 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.78340.log.gz 2024-09-14T22:46:43.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41905.log.gz 2024-09-14T22:46:43.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113168.log 2024-09-14T22:46:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146545.log.gz 2024-09-14T22:46:43.424 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64589.log 2024-09-14T22:46:43.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113168.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113168.log.gz 2024-09-14T22:46:43.425 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85436.log 2024-09-14T22:46:43.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64589.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154367.log 2024-09-14T22:46:43.426 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64589.log.gz 2024-09-14T22:46:43.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85436.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85436.log.gz 2024-09-14T22:46:43.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52156.log 2024-09-14T22:46:43.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154367.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154367.log.gz 2024-09-14T22:46:43.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135784.log 2024-09-14T22:46:43.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52156.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52156.log.gz 2024-09-14T22:46:43.428 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.105234.log 2024-09-14T22:46:43.429 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135784.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135784.log.gz 2024-09-14T22:46:43.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125226.log 2024-09-14T22:46:43.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105234.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105234.log.gz 2024-09-14T22:46:43.430 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139674.log 2024-09-14T22:46:43.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125226.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125226.log.gz 2024-09-14T22:46:43.430 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69007.log 2024-09-14T22:46:43.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139674.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139674.log.gz 2024-09-14T22:46:43.431 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118638.log 2024-09-14T22:46:43.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69007.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69007.log.gz 2024-09-14T22:46:43.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150189.log 2024-09-14T22:46:43.433 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118638.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118638.log.gz 2024-09-14T22:46:43.433 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138987.log 2024-09-14T22:46:43.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150189.log.gz 2024-09-14T22:46:43.434 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128396.log 2024-09-14T22:46:43.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138987.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138987.log.gz 2024-09-14T22:46:43.434 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118337.log 2024-09-14T22:46:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128396.log.gz 2024-09-14T22:46:43.435 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71134.log 2024-09-14T22:46:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118337.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118337.log.gz 2024-09-14T22:46:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43217.log 2024-09-14T22:46:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71134.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71134.log.gz 2024-09-14T22:46:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137886.log 2024-09-14T22:46:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43217.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43217.log.gz 2024-09-14T22:46:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61522.log 2024-09-14T22:46:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137886.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137886.log.gz 2024-09-14T22:46:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63958.log 2024-09-14T22:46:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61522.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61522.log.gz 2024-09-14T22:46:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38884.log 2024-09-14T22:46:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63958.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63958.log.gz 2024-09-14T22:46:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88650.log 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38884.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38884.log.gz 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124317.log 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88650.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88650.log.gz 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38173.log 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124317.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124317.log.gz 2024-09-14T22:46:43.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127678.log 2024-09-14T22:46:43.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38173.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38173.log.gz 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94395.log 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127678.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127678.log.gz 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132331.log 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94395.log.gz 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76955.log 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132331.log.gz 2024-09-14T22:46:43.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114436.log 2024-09-14T22:46:43.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76955.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76955.log.gz 2024-09-14T22:46:43.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109370.log 2024-09-14T22:46:43.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114436.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114436.log.gz 2024-09-14T22:46:43.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129561.log 2024-09-14T22:46:43.454 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109370.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144234.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129561.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129561.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71927.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144234.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144234.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144991.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71927.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51399.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144991.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144991.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116123.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51399.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51399.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107796.log 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116123.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116123.log.gz 2024-09-14T22:46:43.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49219.log 2024-09-14T22:46:43.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107796.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107796.log.gz 2024-09-14T22:46:43.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120181.log 2024-09-14T22:46:43.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49219.log.gz 2024-09-14T22:46:43.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83261.log 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120181.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120181.log.gz 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141122.log 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83261.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83261.log.gz 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136797.log 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141122.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68049.log 0.0% 2024-09-14T22:46:43.457 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.mirror.141122.log.gz 2024-09-14T22:46:43.458 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136797.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136797.log.gz 2024-09-14T22:46:43.458 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82752.log 2024-09-14T22:46:43.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68049.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68049.log.gz 2024-09-14T22:46:43.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99772.log 2024-09-14T22:46:43.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82752.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82752.log.gz 2024-09-14T22:46:43.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129949.log 2024-09-14T22:46:43.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99772.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99772.log.gz 2024-09-14T22:46:43.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144448.log 2024-09-14T22:46:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129949.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129949.log.gz 2024-09-14T22:46:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143421.log 2024-09-14T22:46:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144448.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144448.log.gz 2024-09-14T22:46:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137298.log 2024-09-14T22:46:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143421.log.gz 2024-09-14T22:46:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76222.log 2024-09-14T22:46:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137298.log.gz 2024-09-14T22:46:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49549.log 2024-09-14T22:46:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76222.log.gz 2024-09-14T22:46:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56550.log 2024-09-14T22:46:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49549.log.gz 2024-09-14T22:46:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73072.log 2024-09-14T22:46:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56550.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56550.log.gz 2024-09-14T22:46:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121607.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73072.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73072.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126456.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121607.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61670.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126456.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126456.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151257.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61670.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61670.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150411.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151257.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151257.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120746.log 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150411.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150411.log.gz 2024-09-14T22:46:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46134.log 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120746.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103727.log 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120746.log.gz 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46134.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46134.log.gz 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124634.log 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103727.log.gz 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54045.log 2024-09-14T22:46:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124634.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124634.log.gz 2024-09-14T22:46:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53625.log 2024-09-14T22:46:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54045.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54045.log.gz 2024-09-14T22:46:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34027.log 2024-09-14T22:46:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53625.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53625.log.gz 2024-09-14T22:46:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96880.log 2024-09-14T22:46:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34027.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34027.log.gz 2024-09-14T22:46:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35791.log 2024-09-14T22:46:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96880.log.gz 2024-09-14T22:46:43.478 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120788.log 2024-09-14T22:46:43.478 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35791.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139175.log 2024-09-14T22:46:43.478 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35791.log.gz 2024-09-14T22:46:43.479 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120788.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120788.log.gz 2024-09-14T22:46:43.479 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63815.log 2024-09-14T22:46:43.480 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139175.log.gz 2024-09-14T22:46:43.480 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76825.log 2024-09-14T22:46:43.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63815.log.gz 2024-09-14T22:46:43.481 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88903.log 2024-09-14T22:46:43.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76825.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76825.log.gz 2024-09-14T22:46:43.481 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135997.log 2024-09-14T22:46:43.482 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88903.log.gz 2024-09-14T22:46:43.482 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135639.log 2024-09-14T22:46:43.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135997.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135997.log.gz 2024-09-14T22:46:43.484 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124293.log 2024-09-14T22:46:43.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135639.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135639.log.gz 2024-09-14T22:46:43.484 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140022.log 2024-09-14T22:46:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124293.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124293.log.gz 2024-09-14T22:46:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128269.log 2024-09-14T22:46:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140022.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140022.log.gz 2024-09-14T22:46:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76536.log 2024-09-14T22:46:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128269.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128269.log.gz 2024-09-14T22:46:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.29710.log 2024-09-14T22:46:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76536.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76536.log.gz 2024-09-14T22:46:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95639.log 2024-09-14T22:46:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29710.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.29710.log.gz 2024-09-14T22:46:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37912.log 2024-09-14T22:46:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95639.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95639.log.gz 2024-09-14T22:46:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149884.log 2024-09-14T22:46:43.490 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37912.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108649.log 2024-09-14T22:46:43.490 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37912.log.gz 2024-09-14T22:46:43.490 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149884.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149884.log.gz 2024-09-14T22:46:43.490 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104750.log 2024-09-14T22:46:43.491 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108649.log.gz 2024-09-14T22:46:43.491 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72965.log 2024-09-14T22:46:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104750.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104750.log.gz 2024-09-14T22:46:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61312.log 2024-09-14T22:46:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72965.log.gz 2024-09-14T22:46:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138482.log 2024-09-14T22:46:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61312.log.gz 2024-09-14T22:46:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108650.log 2024-09-14T22:46:43.494 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138482.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138482.log.gz 2024-09-14T22:46:43.494 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90702.log 2024-09-14T22:46:43.495 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108650.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108650.log.gz 2024-09-14T22:46:43.495 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138948.log 2024-09-14T22:46:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90702.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90702.log.gz 2024-09-14T22:46:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125576.log 2024-09-14T22:46:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138948.log.gz 2024-09-14T22:46:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.56726.log 2024-09-14T22:46:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125576.log.gz 2024-09-14T22:46:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90980.log 2024-09-14T22:46:43.498 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.56726.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.56726.log.gz 2024-09-14T22:46:43.498 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131000.log 2024-09-14T22:46:43.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90980.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90980.log.gz 2024-09-14T22:46:43.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51734.log 2024-09-14T22:46:43.500 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131000.log.gz 2024-09-14T22:46:43.500 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127590.log 2024-09-14T22:46:43.500 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51734.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.122111.log 2024-09-14T22:46:43.501 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.51734.log.gz 2024-09-14T22:46:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127590.log.gz 2024-09-14T22:46:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149312.log 2024-09-14T22:46:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122111.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122111.log.gz 2024-09-14T22:46:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125083.log 2024-09-14T22:46:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149312.log.gz 2024-09-14T22:46:43.504 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105206.log 2024-09-14T22:46:43.504 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125083.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125083.log.gz 2024-09-14T22:46:43.504 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116874.log 2024-09-14T22:46:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105206.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105206.log.gz 2024-09-14T22:46:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126502.log 2024-09-14T22:46:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116874.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116874.log.gz 2024-09-14T22:46:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152127.log 2024-09-14T22:46:43.506 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126502.log.gz 2024-09-14T22:46:43.506 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39095.log 2024-09-14T22:46:43.507 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152127.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152127.log.gz 2024-09-14T22:46:43.507 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136627.log 2024-09-14T22:46:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39095.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39095.log.gz 2024-09-14T22:46:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75275.log 2024-09-14T22:46:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136627.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136627.log.gz 2024-09-14T22:46:43.509 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140691.log 2024-09-14T22:46:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75275.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75275.log.gz 2024-09-14T22:46:43.510 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64990.log 2024-09-14T22:46:43.510 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140691.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140691.log.gz 2024-09-14T22:46:43.510 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124481.log 2024-09-14T22:46:43.511 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64990.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64990.log.gz 2024-09-14T22:46:43.511 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150132.log 2024-09-14T22:46:43.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124481.log.gz 2024-09-14T22:46:43.512 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113962.log 2024-09-14T22:46:43.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150132.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150132.log.gz 2024-09-14T22:46:43.513 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148352.log 2024-09-14T22:46:43.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113962.log.gz 2024-09-14T22:46:43.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97843.log 2024-09-14T22:46:43.514 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148352.log.gz 2024-09-14T22:46:43.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51230.log 2024-09-14T22:46:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97843.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97843.log.gz 2024-09-14T22:46:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78731.log 2024-09-14T22:46:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51230.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51230.log.gz 2024-09-14T22:46:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36396.log 2024-09-14T22:46:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78731.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78731.log.gz 2024-09-14T22:46:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52113.log 2024-09-14T22:46:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36396.log.gz 2024-09-14T22:46:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70849.log 2024-09-14T22:46:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52113.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52113.log.gz 2024-09-14T22:46:43.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59479.log 2024-09-14T22:46:43.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70849.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70849.log.gz 2024-09-14T22:46:43.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35238.log 2024-09-14T22:46:43.520 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59479.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44865.log 2024-09-14T22:46:43.520 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59479.log.gz 2024-09-14T22:46:43.521 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35238.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35238.log.gz 2024-09-14T22:46:43.521 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50851.log 2024-09-14T22:46:43.521 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44865.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44865.log.gz 2024-09-14T22:46:43.522 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50599.log 2024-09-14T22:46:43.522 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50851.log.gz 2024-09-14T22:46:43.522 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136096.log 2024-09-14T22:46:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50599.log.gz 2024-09-14T22:46:43.523 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81850.log 2024-09-14T22:46:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136096.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136096.log.gz 2024-09-14T22:46:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132183.log 2024-09-14T22:46:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81850.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81850.log.gz 2024-09-14T22:46:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106613.log 2024-09-14T22:46:43.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132183.log.gz 2024-09-14T22:46:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99523.log 2024-09-14T22:46:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106613.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106613.log.gz 2024-09-14T22:46:43.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113254.log 2024-09-14T22:46:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99523.log.gz 2024-09-14T22:46:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58013.log 2024-09-14T22:46:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113254.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113254.log.gz 2024-09-14T22:46:43.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134969.log 2024-09-14T22:46:43.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58013.log.gz 2024-09-14T22:46:43.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87123.log 2024-09-14T22:46:43.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134969.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134969.log.gz 2024-09-14T22:46:43.530 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89242.log 2024-09-14T22:46:43.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87123.log.gz 2024-09-14T22:46:43.531 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134734.log 2024-09-14T22:46:43.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89242.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89242.log.gz 2024-09-14T22:46:43.532 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78236.log 2024-09-14T22:46:43.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134734.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134734.log.gz 2024-09-14T22:46:43.532 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154743.log 2024-09-14T22:46:43.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78236.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78236.log.gz 2024-09-14T22:46:43.533 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52366.log 2024-09-14T22:46:43.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154743.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154743.log.gz 2024-09-14T22:46:43.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58154.log 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52366.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52366.log.gz 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123687.log 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58154.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58154.log.gz 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98723.log 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123687.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123687.log.gz 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39637.log 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98723.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98723.log.gz 2024-09-14T22:46:43.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71490.log 2024-09-14T22:46:43.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39637.log.gz 2024-09-14T22:46:43.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122403.log 2024-09-14T22:46:43.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71490.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71490.log.gz 2024-09-14T22:46:43.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99692.log 2024-09-14T22:46:43.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122403.log.gz 2024-09-14T22:46:43.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115354.log 2024-09-14T22:46:43.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99692.log.gz 2024-09-14T22:46:43.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68598.log 2024-09-14T22:46:43.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115354.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115354.log.gz 2024-09-14T22:46:43.541 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85227.log 2024-09-14T22:46:43.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68598.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68598.log.gz 2024-09-14T22:46:43.542 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74601.log 2024-09-14T22:46:43.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85227.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85227.log.gz 2024-09-14T22:46:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154391.log 2024-09-14T22:46:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74601.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74601.log.gz 2024-09-14T22:46:43.543 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149506.log 2024-09-14T22:46:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154391.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154391.log.gz 2024-09-14T22:46:43.544 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135163.log 2024-09-14T22:46:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149506.log.gz 2024-09-14T22:46:43.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49175.log 2024-09-14T22:46:43.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135163.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135163.log.gz 2024-09-14T22:46:43.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145744.log 2024-09-14T22:46:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49175.log.gz 2024-09-14T22:46:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93835.log 2024-09-14T22:46:43.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145744.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.145744.log.gz -- 2024-09-14T22:46:43.547 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.102295.log 2024-09-14T22:46:43.548 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93835.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93835.log.gz 2024-09-14T22:46:43.548 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48921.log 2024-09-14T22:46:43.549 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102295.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102295.log.gz 2024-09-14T22:46:43.549 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39009.log 2024-09-14T22:46:43.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48921.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131742.log 2024-09-14T22:46:43.550 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48921.log.gz 2024-09-14T22:46:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39009.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39009.log.gz 2024-09-14T22:46:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103035.log 2024-09-14T22:46:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131742.log.gz 2024-09-14T22:46:43.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52743.log 2024-09-14T22:46:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103035.log.gz 2024-09-14T22:46:43.552 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99859.log 2024-09-14T22:46:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52743.log.gz 2024-09-14T22:46:43.553 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135219.log 2024-09-14T22:46:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99859.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99859.log.gz 2024-09-14T22:46:43.554 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125219.log 2024-09-14T22:46:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135219.log.gz 2024-09-14T22:46:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118829.log 2024-09-14T22:46:43.555 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125219.log.gz 2024-09-14T22:46:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41204.log 2024-09-14T22:46:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118829.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118829.log.gz 2024-09-14T22:46:43.556 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148142.log 2024-09-14T22:46:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41204.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41204.log.gz 2024-09-14T22:46:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92713.log 2024-09-14T22:46:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148142.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148142.log.gz 2024-09-14T22:46:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62951.log 2024-09-14T22:46:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92713.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92713.log.gz 2024-09-14T22:46:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46953.log 2024-09-14T22:46:43.559 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62951.log.gz 2024-09-14T22:46:43.560 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41515.log 2024-09-14T22:46:43.560 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46953.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46953.log.gz 2024-09-14T22:46:43.560 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114483.log 2024-09-14T22:46:43.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41515.log.gz 2024-09-14T22:46:43.561 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63642.log 2024-09-14T22:46:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114483.log.gz 2024-09-14T22:46:43.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88320.log 2024-09-14T22:46:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63642.log.gz 2024-09-14T22:46:43.563 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137171.log 2024-09-14T22:46:43.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88320.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88320.log.gz 2024-09-14T22:46:43.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82155.log 2024-09-14T22:46:43.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137171.log.gz 2024-09-14T22:46:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146016.log 2024-09-14T22:46:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82155.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82155.log.gz 2024-09-14T22:46:43.565 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154785.log 2024-09-14T22:46:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146016.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146016.log.gz 2024-09-14T22:46:43.566 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133759.log 2024-09-14T22:46:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154785.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154785.log.gz 2024-09-14T22:46:43.567 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59611.log 2024-09-14T22:46:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133759.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133759.log.gz 2024-09-14T22:46:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125642.log 2024-09-14T22:46:43.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59611.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59611.log.gz 2024-09-14T22:46:43.569 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137547.log 2024-09-14T22:46:43.569 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125642.log.gz 2024-09-14T22:46:43.569 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72299.log 2024-09-14T22:46:43.570 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137547.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137547.log.gz 2024-09-14T22:46:43.570 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108168.log 2024-09-14T22:46:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72299.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72299.log.gz 2024-09-14T22:46:43.571 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148562.log 2024-09-14T22:46:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108168.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108168.log.gz 2024-09-14T22:46:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103902.log 2024-09-14T22:46:43.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148562.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148562.log.gz 2024-09-14T22:46:43.573 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35101.log 2024-09-14T22:46:43.573 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103902.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103902.log.gz 2024-09-14T22:46:43.573 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59066.log 2024-09-14T22:46:43.574 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35101.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125893.log 2024-09-14T22:46:43.574 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35101.log.gz 2024-09-14T22:46:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59066.log.gz 2024-09-14T22:46:43.575 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53624.log 2024-09-14T22:46:43.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125893.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125893.log.gz 2024-09-14T22:46:43.576 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121773.log 2024-09-14T22:46:43.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53624.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53624.log.gz 2024-09-14T22:46:43.577 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80050.log 2024-09-14T22:46:43.577 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121773.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121773.log.gz 2024-09-14T22:46:43.577 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44057.log 2024-09-14T22:46:43.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80050.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89488.log 2024-09-14T22:46:43.578 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80050.log.gz 2024-09-14T22:46:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44057.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44057.log.gz 2024-09-14T22:46:43.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66290.log 2024-09-14T22:46:43.580 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89488.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89488.log.gz 2024-09-14T22:46:43.580 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136038.log 2024-09-14T22:46:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66290.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66290.log.gz 2024-09-14T22:46:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111752.log 2024-09-14T22:46:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136038.log.gz 2024-09-14T22:46:43.581 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98601.log 2024-09-14T22:46:43.582 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111752.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111752.log.gz 2024-09-14T22:46:43.582 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50138.log 2024-09-14T22:46:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98601.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98601.log.gz 2024-09-14T22:46:43.583 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99637.log 2024-09-14T22:46:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50138.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50138.log.gz 2024-09-14T22:46:43.584 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43771.log 2024-09-14T22:46:43.585 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99637.log.gz 2024-09-14T22:46:43.585 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88524.log 2024-09-14T22:46:43.585 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43771.log.gz 2024-09-14T22:46:43.585 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58294.log 2024-09-14T22:46:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88524.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88524.log.gz 2024-09-14T22:46:43.586 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.57183.log 2024-09-14T22:46:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58294.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.admin.140916.log 2024-09-14T22:46:43.588 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.mirror.58294.log.gz 2024-09-14T22:46:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.57183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.57183.log.gz 2024-09-14T22:46:43.588 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142298.log 2024-09-14T22:46:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140916.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140916.log.gz 2024-09-14T22:46:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77670.log 2024-09-14T22:46:43.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142298.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35817.log 2024-09-14T22:46:43.590 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142298.log.gz 2024-09-14T22:46:43.590 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77670.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77670.log.gzgzip 2024-09-14T22:46:43.590 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145465.log 2024-09-14T22:46:43.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35817.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35817.log.gz 2024-09-14T22:46:43.591 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139843.log 2024-09-14T22:46:43.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145465.log.gz 2024-09-14T22:46:43.591 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64168.log 2024-09-14T22:46:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139843.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139843.log.gz 2024-09-14T22:46:43.592 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66925.log 2024-09-14T22:46:43.593 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64168.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129014.log 2024-09-14T22:46:43.593 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64168.log.gz 2024-09-14T22:46:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66925.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66925.log.gz 2024-09-14T22:46:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106110.log 2024-09-14T22:46:43.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129014.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129014.log.gz 2024-09-14T22:46:43.595 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125743.log 2024-09-14T22:46:43.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106110.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.106110.log.gz 2024-09-14T22:46:43.595 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.61751.log 2024-09-14T22:46:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125743.log.gz 2024-09-14T22:46:43.596 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113166.log 2024-09-14T22:46:43.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61751.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61751.log.gz 2024-09-14T22:46:43.597 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36109.log 2024-09-14T22:46:43.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113166.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113166.log.gz 2024-09-14T22:46:43.598 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86234.log 2024-09-14T22:46:43.598 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36109.log.gz 2024-09-14T22:46:43.598 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145052.log 2024-09-14T22:46:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86234.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125521.log 2024-09-14T22:46:43.599 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86234.log.gz 2024-09-14T22:46:43.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145052.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88567.log 2024-09-14T22:46:43.600 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145052.log.gz 2024-09-14T22:46:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125521.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125521.log.gz 2024-09-14T22:46:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100477.log 2024-09-14T22:46:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88567.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88567.log.gz 2024-09-14T22:46:43.601 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65137.log 2024-09-14T22:46:43.602 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100477.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78663.log 2024-09-14T22:46:43.602 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100477.log.gz 2024-09-14T22:46:43.603 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65137.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.65137.log.gz 2024-09-14T22:46:43.603 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63119.log 2024-09-14T22:46:43.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78663.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78663.log.gz 2024-09-14T22:46:43.604 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103770.log 2024-09-14T22:46:43.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63119.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63119.log.gz 2024-09-14T22:46:43.605 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123727.log 2024-09-14T22:46:43.605 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103770.log.gz 2024-09-14T22:46:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82249.log 2024-09-14T22:46:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123727.log.gz 2024-09-14T22:46:43.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36331.log 2024-09-14T22:46:43.607 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82249.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136624.log 2024-09-14T22:46:43.607 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82249.log.gz 2024-09-14T22:46:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36331.log.gz 2024-09-14T22:46:43.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73361.log 2024-09-14T22:46:43.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136624.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124777.log 2024-09-14T22:46:43.609 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136624.log.gz 2024-09-14T22:46:43.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73361.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73361.log.gz 2024-09-14T22:46:43.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.55006.log 2024-09-14T22:46:43.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124777.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124777.log.gz 2024-09-14T22:46:43.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108297.log 2024-09-14T22:46:43.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.55006.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113012.log 2024-09-14T22:46:43.611 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.55006.log.gz 2024-09-14T22:46:43.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108297.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108297.log.gz 2024-09-14T22:46:43.612 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97778.log 2024-09-14T22:46:43.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113012.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113012.log.gz 2024-09-14T22:46:43.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123433.log 2024-09-14T22:46:43.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97778.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97778.log.gz 2024-09-14T22:46:43.614 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149948.log 2024-09-14T22:46:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123433.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123433.log.gz 2024-09-14T22:46:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63579.log 2024-09-14T22:46:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149948.log.gz 2024-09-14T22:46:43.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128134.log 2024-09-14T22:46:43.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63579.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63579.log.gz 2024-09-14T22:46:43.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53583.log 2024-09-14T22:46:43.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128134.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148245.log 2024-09-14T22:46:43.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128134.log.gz 2024-09-14T22:46:43.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53583.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53583.log.gz 2024-09-14T22:46:43.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135280.log 2024-09-14T22:46:43.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148245.log.gz 2024-09-14T22:46:43.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51189.log 2024-09-14T22:46:43.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135280.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75985.log 2024-09-14T22:46:43.619 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135280.log.gz 2024-09-14T22:46:43.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51189.log.gz 2024-09-14T22:46:43.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132708.log 2024-09-14T22:46:43.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75985.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75985.log.gz 2024-09-14T22:46:43.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117037.log 2024-09-14T22:46:43.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132708.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121983.log 2024-09-14T22:46:43.622 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132708.log.gz 2024-09-14T22:46:43.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117037.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117037.log.gz 2024-09-14T22:46:43.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52028.log 2024-09-14T22:46:43.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121983.log.gz 2024-09-14T22:46:43.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72080.log 2024-09-14T22:46:43.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52028.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52028.log.gz 2024-09-14T22:46:43.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131241.log 2024-09-14T22:46:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72080.log.gz 2024-09-14T22:46:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149402.log 2024-09-14T22:46:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131241.log.gz 2024-09-14T22:46:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128613.log 2024-09-14T22:46:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149402.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106566.log 2024-09-14T22:46:43.627 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149402.log.gz 2024-09-14T22:46:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128613.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128613.log.gz 2024-09-14T22:46:43.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153941.log 2024-09-14T22:46:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106566.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106566.log.gz 2024-09-14T22:46:43.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154533.log 2024-09-14T22:46:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153941.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153941.log.gz 2024-09-14T22:46:43.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60897.log 2024-09-14T22:46:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154533.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154533.log.gz 2024-09-14T22:46:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152574.log 2024-09-14T22:46:43.630 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60897.log.gz 2024-09-14T22:46:43.631 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93157.log 2024-09-14T22:46:43.631 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152574.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115286.log 2024-09-14T22:46:43.632 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152574.log.gz 2024-09-14T22:46:43.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93157.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93157.log.gz 2024-09-14T22:46:43.632 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58750.log 2024-09-14T22:46:43.633 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115286.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115286.log.gz 2024-09-14T22:46:43.633 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72693.log 2024-09-14T22:46:43.634 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58750.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58750.log.gz 2024-09-14T22:46:43.634 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45977.log 2024-09-14T22:46:43.634 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72693.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72693.log.gz 2024-09-14T22:46:43.635 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39345.log 2024-09-14T22:46:43.635 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45977.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45977.log.gz -5 --verbose 2024-09-14T22:46:43.635 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.38796.log 2024-09-14T22:46:43.636 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39345.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39345.log.gz 2024-09-14T22:46:43.636 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72235.log 2024-09-14T22:46:43.637 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38796.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38796.log.gz -5 2024-09-14T22:46:43.637 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.101790.log 2024-09-14T22:46:43.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72235.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72235.log.gz 2024-09-14T22:46:43.638 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98641.log 2024-09-14T22:46:43.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101790.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101790.log.gz 2024-09-14T22:46:43.639 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135578.log 2024-09-14T22:46:43.639 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98641.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.98641.log.gz /var/log/ceph/cluster2-client.mirror.94441.log 2024-09-14T22:46:43.639 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:43.640 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135578.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153035.log 2024-09-14T22:46:43.640 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135578.log.gz 2024-09-14T22:46:43.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94441.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94441.log.gzgzip 2024-09-14T22:46:43.641 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.55046.log 2024-09-14T22:46:43.642 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153035.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153035.log.gz 2024-09-14T22:46:43.642 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47548.log 2024-09-14T22:46:43.643 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.55046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.55046.log.gz 2024-09-14T22:46:43.643 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87724.log 2024-09-14T22:46:43.643 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47548.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58449.log 2024-09-14T22:46:43.644 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47548.log.gz 2024-09-14T22:46:43.644 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87724.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87724.log.gz 2024-09-14T22:46:43.644 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147091.log 2024-09-14T22:46:43.645 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58449.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58449.log.gz 2024-09-14T22:46:43.645 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152193.log 2024-09-14T22:46:43.646 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147091.log.gz 2024-09-14T22:46:43.646 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74963.log 2024-09-14T22:46:43.647 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152193.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152193.log.gz 2024-09-14T22:46:43.647 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102787.log 2024-09-14T22:46:43.648 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74963.log.gz 2024-09-14T22:46:43.648 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147323.log 2024-09-14T22:46:43.648 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102787.log.gz 2024-09-14T22:46:43.648 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48337.log 2024-09-14T22:46:43.649 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147323.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147323.log.gz 2024-09-14T22:46:43.649 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85122.log 2024-09-14T22:46:43.650 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48337.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48337.log.gz 2024-09-14T22:46:43.650 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108691.log 2024-09-14T22:46:43.651 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85122.log.gz 2024-09-14T22:46:43.651 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150432.log 2024-09-14T22:46:43.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108691.log.gz 2024-09-14T22:46:43.652 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102401.log 2024-09-14T22:46:43.653 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150432.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150432.log.gz 2024-09-14T22:46:43.653 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81812.log 2024-09-14T22:46:43.654 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102401.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102401.log.gz 2024-09-14T22:46:43.654 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113792.log 2024-09-14T22:46:43.654 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81812.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81812.log.gz 2024-09-14T22:46:43.654 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94482.log 2024-09-14T22:46:43.655 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113792.log.gz 2024-09-14T22:46:43.655 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95556.log 2024-09-14T22:46:43.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94482.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94482.log.gz 2024-09-14T22:46:43.656 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100530.log 2024-09-14T22:46:43.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95556.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95556.log.gz 2024-09-14T22:46:43.656 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123331.log 2024-09-14T22:46:43.657 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100530.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100530.log.gz 2024-09-14T22:46:43.657 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48404.log 2024-09-14T22:46:43.658 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123331.log.gz 2024-09-14T22:46:43.658 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97089.log 2024-09-14T22:46:43.659 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48404.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48404.log.gz 2024-09-14T22:46:43.659 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101663.log 2024-09-14T22:46:43.659 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97089.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97089.log.gz 2024-09-14T22:46:43.660 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103574.log 2024-09-14T22:46:43.660 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101663.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101663.log.gz 2024-09-14T22:46:43.660 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138448.log 2024-09-14T22:46:43.661 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103574.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103574.log.gz 2024-09-14T22:46:43.661 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91947.log 2024-09-14T22:46:43.662 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138448.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138448.log.gz 2024-09-14T22:46:43.662 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86086.log 2024-09-14T22:46:43.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91947.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91947.log.gz 2024-09-14T22:46:43.663 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112242.log 2024-09-14T22:46:43.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86086.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86086.log.gz 2024-09-14T22:46:43.664 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154169.log 2024-09-14T22:46:43.664 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112242.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112242.log.gz 2024-09-14T22:46:43.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79019.log 2024-09-14T22:46:43.665 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154169.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.154169.log.gz 2024-09-14T22:46:43.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119389.log 2024-09-14T22:46:43.666 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79019.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79019.log.gz 2024-09-14T22:46:43.666 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122026.log 2024-09-14T22:46:43.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119389.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119389.log.gz 2024-09-14T22:46:43.667 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63000.log 2024-09-14T22:46:43.668 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122026.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122026.log.gz 2024-09-14T22:46:43.668 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94006.log 2024-09-14T22:46:43.669 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63000.log.gz 2024-09-14T22:46:43.669 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40057.log 2024-09-14T22:46:43.669 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94006.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94006.log.gz 2024-09-14T22:46:43.670 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-osd.2.log 2024-09-14T22:46:43.670 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40057.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40057.log.gz 2024-09-14T22:46:43.670 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107585.log 2024-09-14T22:46:43.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64830.log 2024-09-14T22:46:43.672 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107585.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107585.log.gz 2024-09-14T22:46:43.672 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110851.log 2024-09-14T22:46:43.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64830.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110770.log 2024-09-14T22:46:43.673 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64830.log.gz 2024-09-14T22:46:43.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110851.log.gz 2024-09-14T22:46:43.674 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133128.log 2024-09-14T22:46:43.674 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110770.log.gz 2024-09-14T22:46:43.674 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141573.log 2024-09-14T22:46:43.675 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133128.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133128.log.gz 2024-09-14T22:46:43.675 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80928.log 2024-09-14T22:46:43.676 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141573.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141573.log.gz 2024-09-14T22:46:43.676 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54087.log 2024-09-14T22:46:43.677 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80928.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80928.log.gz 2024-09-14T22:46:43.677 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.0.34688.log 2024-09-14T22:46:43.677 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54087.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54087.log.gz 2024-09-14T22:46:43.678 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69168.log 2024-09-14T22:46:43.678 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.0.34688.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87124.log 2024-09-14T22:46:43.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69168.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69168.log.gz 2024-09-14T22:46:43.679 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95425.log 2024-09-14T22:46:43.680 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87124.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87124.log.gz 2024-09-14T22:46:43.680 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136206.log 2024-09-14T22:46:43.681 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95425.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95425.log.gz 2024-09-14T22:46:43.681 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114099.log 2024-09-14T22:46:43.681 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136206.log.gz 2024-09-14T22:46:43.682 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.45189.log 2024-09-14T22:46:43.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114099.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114099.log.gz 2024-09-14T22:46:43.682 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123790.log 2024-09-14T22:46:43.683 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.45189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.45189.log.gz 2024-09-14T22:46:43.683 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126165.log 2024-09-14T22:46:43.684 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123790.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123790.log.gzgzip 2024-09-14T22:46:43.684 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109193.log 2024-09-14T22:46:43.685 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126165.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126165.log.gz 2024-09-14T22:46:43.685 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36485.log 2024-09-14T22:46:43.685 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109193.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109193.log.gz 2024-09-14T22:46:43.686 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139109.log 2024-09-14T22:46:43.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36485.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36485.log.gz 2024-09-14T22:46:43.686 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141500.log 2024-09-14T22:46:43.687 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139109.log.gz 2024-09-14T22:46:43.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137341.log 2024-09-14T22:46:43.688 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141500.log.gz 2024-09-14T22:46:43.688 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63581.log 2024-09-14T22:46:43.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137341.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137341.log.gz 2024-09-14T22:46:43.689 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64233.log 2024-09-14T22:46:43.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63581.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63581.log.gz 2024-09-14T22:46:43.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119680.log 2024-09-14T22:46:43.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64233.log.gz 2024-09-14T22:46:43.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152831.log 2024-09-14T22:46:43.691 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119680.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119680.log.gz 2024-09-14T22:46:43.691 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95088.log 2024-09-14T22:46:43.692 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152831.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152831.log.gz 2024-09-14T22:46:43.692 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134006.log 2024-09-14T22:46:43.693 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95088.log.gz 2024-09-14T22:46:43.693 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66812.log 2024-09-14T22:46:43.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134006.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134006.log.gz 2024-09-14T22:46:43.694 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105675.log 2024-09-14T22:46:43.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66812.log.gz 2024-09-14T22:46:43.694 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147301.log 2024-09-14T22:46:43.695 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105675.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105675.log.gz 2024-09-14T22:46:43.695 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148350.log 2024-09-14T22:46:43.696 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147301.log.gz 2024-09-14T22:46:43.696 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24931.log 2024-09-14T22:46:43.697 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148350.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148350.log.gz 2024-09-14T22:46:43.697 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74538.log 2024-09-14T22:46:43.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.tmp-client.admin.24931.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24931.log.gz 2024-09-14T22:46:43.698 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79720.log 2024-09-14T22:46:43.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74538.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74538.log.gz 2024-09-14T22:46:43.698 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41740.log 2024-09-14T22:46:43.699 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79720.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.admin.79720.log.gz -- 2024-09-14T22:46:43.699 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.103991.log 2024-09-14T22:46:43.700 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41740.log.gz 2024-09-14T22:46:43.700 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128369.log 2024-09-14T22:46:43.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103991.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103991.log.gz 2024-09-14T22:46:43.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146670.log 2024-09-14T22:46:43.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128369.log.gz 2024-09-14T22:46:43.702 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42368.log 2024-09-14T22:46:43.702 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146670.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146670.log.gz 2024-09-14T22:46:43.702 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49131.log 2024-09-14T22:46:43.703 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42368.log.gz 2024-09-14T22:46:43.703 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82725.log 2024-09-14T22:46:43.704 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49131.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49131.log.gz 2024-09-14T22:46:43.704 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111358.log 2024-09-14T22:46:43.705 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82725.log.gz 2024-09-14T22:46:43.705 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.48138.log 2024-09-14T22:46:43.705 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111358.log.gz 2024-09-14T22:46:43.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47943.log 2024-09-14T22:46:43.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.48138.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.48138.log.gz 2024-09-14T22:46:43.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143721.log 2024-09-14T22:46:43.707 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47943.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47943.log.gz 2024-09-14T22:46:43.707 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35323.log 2024-09-14T22:46:43.708 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143721.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151464.log 2024-09-14T22:46:43.708 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143721.log.gz 2024-09-14T22:46:43.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35323.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35323.log.gz 2024-09-14T22:46:43.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104342.log 2024-09-14T22:46:43.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151464.log.gz 2024-09-14T22:46:43.710 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38675.log 2024-09-14T22:46:43.710 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104342.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104342.log.gz 2024-09-14T22:46:43.710 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148433.log 2024-09-14T22:46:43.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38675.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38675.log.gz 2024-09-14T22:46:43.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83786.log 2024-09-14T22:46:43.712 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148433.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148433.log.gz 2024-09-14T22:46:43.712 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112306.log 2024-09-14T22:46:43.712 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83786.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83786.log.gz 2024-09-14T22:46:43.713 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124366.log 2024-09-14T22:46:43.713 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112306.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124839.log 2024-09-14T22:46:43.713 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112306.log.gz 2024-09-14T22:46:43.714 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124366.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124366.log.gz 2024-09-14T22:46:43.714 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106814.log 2024-09-14T22:46:43.715 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124839.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124839.log.gz 2024-09-14T22:46:43.715 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71928.log 2024-09-14T22:46:43.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106814.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106814.log.gz 2024-09-14T22:46:43.716 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90782.log 2024-09-14T22:46:43.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71928.log.gz 2024-09-14T22:46:43.717 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121352.log 2024-09-14T22:46:43.717 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90782.log.gz 2024-09-14T22:46:43.717 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140271.log 2024-09-14T22:46:43.718 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121352.log.gz 2024-09-14T22:46:43.718 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149821.log 2024-09-14T22:46:43.719 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140271.log.gz 2024-09-14T22:46:43.719 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122488.log 2024-09-14T22:46:43.720 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149821.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149821.log.gz 2024-09-14T22:46:43.720 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153192.log 2024-09-14T22:46:43.721 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122488.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122488.log.gz 2024-09-14T22:46:43.721 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133339.log 2024-09-14T22:46:43.721 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153192.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153192.log.gz 2024-09-14T22:46:43.721 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98788.log 2024-09-14T22:46:43.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133339.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.133339.log.gz -5 2024-09-14T22:46:43.722 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.122281.log 2024-09-14T22:46:43.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98788.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.98788.log.gz /var/log/ceph/cluster1-client.mirror.111885.log 2024-09-14T22:46:43.723 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:43.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122281.log.gz 2024-09-14T22:46:43.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74182.log 2024-09-14T22:46:43.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111885.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111885.log.gz 2024-09-14T22:46:43.725 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52489.log 2024-09-14T22:46:43.725 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74182.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132184.log 2024-09-14T22:46:43.725 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74182.log.gz 2024-09-14T22:46:43.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52489.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52489.log.gz 2024-09-14T22:46:43.726 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99439.log 2024-09-14T22:46:43.727 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132184.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132184.log.gz 2024-09-14T22:46:43.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110075.log 2024-09-14T22:46:43.728 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99439.log.gz 2024-09-14T22:46:43.728 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63814.log 2024-09-14T22:46:43.728 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110075.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110075.log.gz 2024-09-14T22:46:43.729 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.72534.log 2024-09-14T22:46:43.729 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63814.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63814.log.gz 2024-09-14T22:46:43.729 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40898.log 2024-09-14T22:46:43.730 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.72534.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76030.log 2024-09-14T22:46:43.730 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.72534.log.gz 2024-09-14T22:46:43.731 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40898.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40898.log.gz 2024-09-14T22:46:43.731 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82866.log 2024-09-14T22:46:43.731 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76030.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76030.log.gz 2024-09-14T22:46:43.732 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104480.log 2024-09-14T22:46:43.732 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82866.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82866.log.gz 2024-09-14T22:46:43.732 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130177.log 2024-09-14T22:46:43.733 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104480.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58522.log 2024-09-14T22:46:43.733 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104480.log.gz 2024-09-14T22:46:43.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130177.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130177.log.gz 2024-09-14T22:46:43.734 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153113.log 2024-09-14T22:46:43.735 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58522.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58522.log.gz 2024-09-14T22:46:43.735 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136941.log 2024-09-14T22:46:43.735 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153113.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153113.log.gz 2024-09-14T22:46:43.736 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101871.log 2024-09-14T22:46:43.736 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136941.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136941.log.gzgzip 2024-09-14T22:46:43.736 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146999.log 2024-09-14T22:46:43.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101871.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.101871.log.gz 2024-09-14T22:46:43.737 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.59962.log 2024-09-14T22:46:43.738 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146999.log.gz 2024-09-14T22:46:43.738 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61219.log 2024-09-14T22:46:43.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59962.log.gz 2024-09-14T22:46:43.739 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109678.log 2024-09-14T22:46:43.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61219.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61219.log.gz 2024-09-14T22:46:43.739 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46974.log 2024-09-14T22:46:43.740 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109678.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.109678.log.gz 2024-09-14T22:46:43.740 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.138901.log 2024-09-14T22:46:43.741 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46974.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46974.log.gz 2024-09-14T22:46:43.741 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97694.log 2024-09-14T22:46:43.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138901.log.gz 2024-09-14T22:46:43.742 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62617.log 2024-09-14T22:46:43.743 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97694.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97694.log.gz 2024-09-14T22:46:43.743 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57458.log 2024-09-14T22:46:43.746 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62617.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62617.log.gz 2024-09-14T22:46:43.746 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107971.log 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57458.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57458.log.gz 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129701.log 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107971.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107971.log.gz 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40625.log 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129701.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129701.log.gz 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51290.log 2024-09-14T22:46:43.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40625.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40625.log.gz 2024-09-14T22:46:43.748 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93303.log 2024-09-14T22:46:43.748 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51290.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51290.log.gz 2024-09-14T22:46:43.748 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110936.log 2024-09-14T22:46:43.749 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93303.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93303.log.gz 2024-09-14T22:46:43.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83439.log 2024-09-14T22:46:43.749 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110936.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110936.log.gz 2024-09-14T22:46:43.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50032.log 2024-09-14T22:46:43.750 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83439.log.gz 2024-09-14T22:46:43.750 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39765.log 2024-09-14T22:46:43.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50032.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50032.log.gz 2024-09-14T22:46:43.751 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112703.log 2024-09-14T22:46:43.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39765.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39765.log.gz 2024-09-14T22:46:43.752 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86679.log 2024-09-14T22:46:43.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112703.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112703.log.gz 2024-09-14T22:46:43.752 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34982.log 2024-09-14T22:46:43.753 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86679.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86679.log.gz 2024-09-14T22:46:43.753 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79501.log 2024-09-14T22:46:43.754 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.34982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34982.log.gz 2024-09-14T22:46:43.754 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96753.log 2024-09-14T22:46:43.755 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79501.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79501.log.gz 2024-09-14T22:46:43.755 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.44824.log 2024-09-14T22:46:43.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96753.log.gz 2024-09-14T22:46:43.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47880.log 2024-09-14T22:46:43.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44824.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44824.log.gz 2024-09-14T22:46:43.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120584.log 2024-09-14T22:46:43.757 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47880.log.gz 2024-09-14T22:46:43.757 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73968.log 2024-09-14T22:46:43.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120584.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120584.log.gz 2024-09-14T22:46:43.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72470.log 2024-09-14T22:46:43.759 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73968.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73968.log.gz 2024-09-14T22:46:43.759 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.143464.log 2024-09-14T22:46:43.759 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72470.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72470.log.gz 2024-09-14T22:46:43.760 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90979.log 2024-09-14T22:46:43.760 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.143464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.143464.log.gz 2024-09-14T22:46:43.760 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54255.log 2024-09-14T22:46:43.761 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90979.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90979.log.gz 2024-09-14T22:46:43.761 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89702.log 2024-09-14T22:46:43.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54255.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54255.log.gz 2024-09-14T22:46:43.762 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95946.log 2024-09-14T22:46:43.763 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89702.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89702.log.gz 2024-09-14T22:46:43.763 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59872.log 2024-09-14T22:46:43.763 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95946.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95946.log.gz 2024-09-14T22:46:43.764 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108260.log 2024-09-14T22:46:43.764 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59872.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59872.log.gz 2024-09-14T22:46:43.764 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76364.log 2024-09-14T22:46:43.765 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108260.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108260.log.gz 2024-09-14T22:46:43.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138370.log 2024-09-14T22:46:43.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76364.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76364.log.gz 2024-09-14T22:46:43.766 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84029.log 2024-09-14T22:46:43.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138370.log.gz 2024-09-14T22:46:43.767 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124169.log 2024-09-14T22:46:43.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84029.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84029.log.gz 2024-09-14T22:46:43.767 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42116.log 2024-09-14T22:46:43.768 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124169.log.gz 2024-09-14T22:46:43.768 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151035.log 2024-09-14T22:46:43.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42116.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42116.log.gz 2024-09-14T22:46:43.769 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154055.log 2024-09-14T22:46:43.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151035.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71396.log 2024-09-14T22:46:43.770 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151035.log.gz 2024-09-14T22:46:43.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154055.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.mirror.45079.log -- replaced with /var/log/ceph/cluster2-client.mirror.154055.log.gz 2024-09-14T22:46:43.771 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:43.771 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71396.log.gz 2024-09-14T22:46:43.771 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137928.log 2024-09-14T22:46:43.772 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45079.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45079.log.gz 2024-09-14T22:46:43.772 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69494.log 2024-09-14T22:46:43.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137928.log.gz 2024-09-14T22:46:43.773 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58636.log 2024-09-14T22:46:43.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69494.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69494.log.gz 2024-09-14T22:46:43.774 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154257.log 2024-09-14T22:46:43.775 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58636.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58636.log.gz 2024-09-14T22:46:43.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101244.log 2024-09-14T22:46:43.775 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154257.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154257.log.gz 2024-09-14T22:46:43.776 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40270.log 2024-09-14T22:46:43.776 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101244.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101244.log.gz 2024-09-14T22:46:43.776 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113121.log 2024-09-14T22:46:43.777 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40270.log.gz 2024-09-14T22:46:43.777 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111002.log 2024-09-14T22:46:43.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113121.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113121.log.gz 2024-09-14T22:46:43.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68897.log 2024-09-14T22:46:43.779 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111002.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111002.log.gz 2024-09-14T22:46:43.779 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58791.log 2024-09-14T22:46:43.780 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68897.log.gz 2024-09-14T22:46:43.780 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120848.log 2024-09-14T22:46:43.780 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58791.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58791.log.gz 2024-09-14T22:46:43.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95594.log 2024-09-14T22:46:43.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120848.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120848.log.gz 2024-09-14T22:46:43.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40897.log 2024-09-14T22:46:43.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95594.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95594.log.gz 2024-09-14T22:46:43.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105975.log 2024-09-14T22:46:43.783 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40897.log.gz 2024-09-14T22:46:43.783 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81298.log 2024-09-14T22:46:43.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105975.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105975.log.gz 2024-09-14T22:46:43.784 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142351.log 2024-09-14T22:46:43.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81298.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81298.log.gz 2024-09-14T22:46:43.784 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108123.log 2024-09-14T22:46:43.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142351.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142351.log.gz 2024-09-14T22:46:43.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151123.log 2024-09-14T22:46:43.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108123.log.gz 2024-09-14T22:46:43.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49927.log 2024-09-14T22:46:43.787 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151123.log.gz 2024-09-14T22:46:43.788 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43303.log 2024-09-14T22:46:43.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49927.log.gz 2024-09-14T22:46:43.788 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123434.log 2024-09-14T22:46:43.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43303.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43303.log.gz 2024-09-14T22:46:43.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146371.log 2024-09-14T22:46:43.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123434.log.gz 2024-09-14T22:46:43.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124062.log 2024-09-14T22:46:43.790 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146371.log.gz 2024-09-14T22:46:43.791 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115907.log 2024-09-14T22:46:43.791 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124062.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124062.log.gz 2024-09-14T22:46:43.791 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82591.log 2024-09-14T22:46:43.791 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115907.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115907.log.gz 2024-09-14T22:46:43.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52195.log 2024-09-14T22:46:43.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82591.log.gz 2024-09-14T22:46:43.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80116.log 2024-09-14T22:46:43.793 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52195.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52195.log.gz 2024-09-14T22:46:43.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152036.log 2024-09-14T22:46:43.794 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80116.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80116.log.gz 2024-09-14T22:46:43.794 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56887.log 2024-09-14T22:46:43.795 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152036.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152036.log.gz 2024-09-14T22:46:43.795 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77397.log 2024-09-14T22:46:43.795 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56887.log.gz 2024-09-14T22:46:43.795 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135680.log 2024-09-14T22:46:43.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77397.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77397.log.gz 2024-09-14T22:46:43.796 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50557.log 2024-09-14T22:46:43.797 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135680.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135680.log.gzgzip 2024-09-14T22:46:43.797 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90327.log 2024-09-14T22:46:43.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50557.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50557.log.gz 2024-09-14T22:46:43.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103836.log 2024-09-14T22:46:43.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90327.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90327.log.gz 2024-09-14T22:46:43.799 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36764.log 2024-09-14T22:46:43.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103836.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103836.log.gz 2024-09-14T22:46:43.800 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119660.log 2024-09-14T22:46:43.800 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36764.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36764.log.gz 2024-09-14T22:46:43.800 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70870.log 2024-09-14T22:46:43.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119660.log.gz 2024-09-14T22:46:43.801 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101540.log 2024-09-14T22:46:43.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70870.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70870.log.gz 2024-09-14T22:46:43.802 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35931.log 2024-09-14T22:46:43.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101540.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101540.log.gz 2024-09-14T22:46:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39175.log 2024-09-14T22:46:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35931.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35931.log.gz 2024-09-14T22:46:43.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120491.log 2024-09-14T22:46:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39175.log.gz 2024-09-14T22:46:43.804 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60504.log 2024-09-14T22:46:43.805 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120491.log.gz 2024-09-14T22:46:43.805 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110580.log 2024-09-14T22:46:43.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60504.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60504.log.gz 2024-09-14T22:46:43.806 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102149.log 2024-09-14T22:46:43.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110580.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.110580.log.gz 2024-09-14T22:46:43.807 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.91948.log 2024-09-14T22:46:43.807 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102149.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102149.log.gz 2024-09-14T22:46:43.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50349.log 2024-09-14T22:46:43.808 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91948.log.gz 2024-09-14T22:46:43.808 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139440.log 2024-09-14T22:46:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50349.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50349.log.gz 2024-09-14T22:46:43.809 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116875.log 2024-09-14T22:46:43.810 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139440.log.gz 2024-09-14T22:46:43.810 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57962.log 2024-09-14T22:46:43.811 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116875.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116875.log.gz 2024-09-14T22:46:43.811 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99565.log 2024-09-14T22:46:43.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57962.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57962.log.gz 2024-09-14T22:46:43.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125848.log 2024-09-14T22:46:43.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99565.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99565.log.gz 2024-09-14T22:46:43.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92731.log 2024-09-14T22:46:43.813 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125848.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125848.log.gz 2024-09-14T22:46:43.813 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137466.log 2024-09-14T22:46:43.814 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92731.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92731.log.gz 2024-09-14T22:46:43.814 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123283.log 2024-09-14T22:46:43.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137466.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137466.log.gz 2024-09-14T22:46:43.815 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137842.log 2024-09-14T22:46:43.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123283.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123283.log.gz 2024-09-14T22:46:43.816 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139197.log 2024-09-14T22:46:43.816 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137842.log.gz 2024-09-14T22:46:43.816 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81293.log 2024-09-14T22:46:43.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139197.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139197.log.gz 2024-09-14T22:46:43.817 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71990.log 2024-09-14T22:46:43.818 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81293.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81293.log.gz 2024-09-14T22:46:43.818 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146586.log 2024-09-14T22:46:43.818 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71990.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113332.log 2024-09-14T22:46:43.819 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71990.log.gz 2024-09-14T22:46:43.819 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146586.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146586.log.gz 2024-09-14T22:46:43.819 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128941.log 2024-09-14T22:46:43.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113332.log.gz 2024-09-14T22:46:43.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54867.log 2024-09-14T22:46:43.821 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128941.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128941.log.gz 2024-09-14T22:46:43.821 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108543.log 2024-09-14T22:46:43.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54867.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54867.log.gz 2024-09-14T22:46:43.822 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135699.log 2024-09-14T22:46:43.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108543.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108543.log.gz 2024-09-14T22:46:43.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122678.log 2024-09-14T22:46:43.823 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135699.log.gz 2024-09-14T22:46:43.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96271.log 2024-09-14T22:46:43.824 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122678.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122678.log.gz 2024-09-14T22:46:43.824 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96818.log 2024-09-14T22:46:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96271.log.gz 2024-09-14T22:46:43.825 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126098.log 2024-09-14T22:46:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96818.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96818.log.gz 2024-09-14T22:46:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124108.log 2024-09-14T22:46:43.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126098.log.gz 2024-09-14T22:46:43.827 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97631.log 2024-09-14T22:46:43.827 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124108.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124108.log.gz 2024-09-14T22:46:43.827 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47330.log 2024-09-14T22:46:43.828 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97631.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97631.log.gz 2024-09-14T22:46:43.828 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39638.log 2024-09-14T22:46:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47330.log.gz 2024-09-14T22:46:43.829 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56024.log 2024-09-14T22:46:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39638.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39638.log.gz 2024-09-14T22:46:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126546.log 2024-09-14T22:46:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56024.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56024.log.gz 2024-09-14T22:46:43.830 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89281.log 2024-09-14T22:46:43.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126546.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126546.log.gz 2024-09-14T22:46:43.831 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55626.log 2024-09-14T22:46:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89281.log.gz 2024-09-14T22:46:43.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142542.log 2024-09-14T22:46:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55626.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55626.log.gz 2024-09-14T22:46:43.833 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109720.log 2024-09-14T22:46:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142542.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142542.log.gz 2024-09-14T22:46:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105724.log 2024-09-14T22:46:43.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109720.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109720.log.gz 2024-09-14T22:46:43.835 INFO:teuthology.orchestra.run.smithi169.stderr: 82.2% -- replaced with /var/log/ceph/cluster1-client.mirror.0.34688.log.gz 2024-09-14T22:46:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99154.log 2024-09-14T22:46:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105724.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105724.log.gz 2024-09-14T22:46:43.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147992.log 2024-09-14T22:46:43.836 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99154.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99154.log.gz 2024-09-14T22:46:43.836 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97404.log 2024-09-14T22:46:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147992.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147992.log.gz 2024-09-14T22:46:43.837 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44190.log 2024-09-14T22:46:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97404.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97404.log.gz 2024-09-14T22:46:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122532.log 2024-09-14T22:46:43.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44190.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44190.log.gz 2024-09-14T22:46:43.839 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53581.log 2024-09-14T22:46:43.839 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122532.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122532.log.gz 2024-09-14T22:46:43.839 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65368.log 2024-09-14T22:46:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53581.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53581.log.gz 2024-09-14T22:46:43.840 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111609.log 2024-09-14T22:46:43.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65368.log.gz 2024-09-14T22:46:43.841 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51145.log 2024-09-14T22:46:43.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111609.log.gz 2024-09-14T22:46:43.842 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109804.log 2024-09-14T22:46:43.843 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51145.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51145.log.gz 2024-09-14T22:46:43.843 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66921.log 2024-09-14T22:46:43.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109804.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109804.log.gz 2024-09-14T22:46:43.844 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147721.log 2024-09-14T22:46:43.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66921.log.gz 2024-09-14T22:46:43.844 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122404.log 2024-09-14T22:46:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147721.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147721.log.gz 2024-09-14T22:46:43.845 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128107.log 2024-09-14T22:46:43.846 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122404.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95051.log 0.0% 2024-09-14T22:46:43.846 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.122404.log.gz 2024-09-14T22:46:43.847 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128107.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128107.log.gz 2024-09-14T22:46:43.847 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91352.log 2024-09-14T22:46:43.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95051.log.gz 2024-09-14T22:46:43.848 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106016.log 2024-09-14T22:46:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91352.log.gz 2024-09-14T22:46:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131657.log 2024-09-14T22:46:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106016.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106016.log.gz 2024-09-14T22:46:43.849 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102811.log 2024-09-14T22:46:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131657.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131657.log.gz 2024-09-14T22:46:43.850 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120365.log 2024-09-14T22:46:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102811.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102811.log.gz 2024-09-14T22:46:43.851 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81112.log 2024-09-14T22:46:43.852 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120365.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120365.log.gz 2024-09-14T22:46:43.852 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144087.log 2024-09-14T22:46:43.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81112.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81112.log.gz 2024-09-14T22:46:43.853 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43046.log 2024-09-14T22:46:43.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144087.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144087.log.gz 2024-09-14T22:46:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121774.log 2024-09-14T22:46:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43046.log.gz 2024-09-14T22:46:43.854 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63961.log 2024-09-14T22:46:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121774.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121774.log.gz 2024-09-14T22:46:43.855 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36437.log 2024-09-14T22:46:43.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63961.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63961.log.gz 2024-09-14T22:46:43.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59262.log 2024-09-14T22:46:43.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36437.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36437.log.gz 2024-09-14T22:46:43.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90248.log 2024-09-14T22:46:43.858 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59262.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59262.log.gz 2024-09-14T22:46:43.858 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75695.log 2024-09-14T22:46:43.858 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90248.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90248.log.gz 2024-09-14T22:46:43.858 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85563.log 2024-09-14T22:46:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75695.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75695.log.gz 2024-09-14T22:46:43.859 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99983.log 2024-09-14T22:46:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85563.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85563.log.gz 2024-09-14T22:46:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76958.log 2024-09-14T22:46:43.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99983.log.gz 2024-09-14T22:46:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68291.log 2024-09-14T22:46:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76958.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76958.log.gz 2024-09-14T22:46:43.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135825.log 2024-09-14T22:46:43.862 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68291.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68291.log.gz 2024-09-14T22:46:43.862 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142439.log 2024-09-14T22:46:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135825.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135825.log.gz 2024-09-14T22:46:43.863 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114470.log 2024-09-14T22:46:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142439.log.gz 2024-09-14T22:46:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100824.log 2024-09-14T22:46:43.864 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114470.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114470.log.gz 2024-09-14T22:46:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37476.log 2024-09-14T22:46:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100824.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100824.log.gz 2024-09-14T22:46:43.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40836.log 2024-09-14T22:46:43.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37476.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37476.log.gz 2024-09-14T22:46:43.866 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109111.log 2024-09-14T22:46:43.867 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40836.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40836.log.gz 2024-09-14T22:46:43.867 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132752.log 2024-09-14T22:46:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109111.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109111.log.gz 2024-09-14T22:46:43.868 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139528.log 2024-09-14T22:46:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132752.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132752.log.gz 2024-09-14T22:46:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121144.log 2024-09-14T22:46:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139528.log.gz 2024-09-14T22:46:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100403.log 2024-09-14T22:46:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121144.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121144.log.gz 2024-09-14T22:46:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98599.log 2024-09-14T22:46:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100403.log.gz 2024-09-14T22:46:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113687.log 2024-09-14T22:46:43.872 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98599.log.gz 2024-09-14T22:46:43.872 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87476.log 2024-09-14T22:46:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113687.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113687.log.gz 2024-09-14T22:46:43.873 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117814.log 2024-09-14T22:46:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87476.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87476.log.gz 2024-09-14T22:46:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105099.log 2024-09-14T22:46:43.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117814.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.admin.117814.log.gz -- 2024-09-14T22:46:43.874 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.77334.log 2024-09-14T22:46:43.875 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105099.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105099.log.gz 2024-09-14T22:46:43.875 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127634.log 2024-09-14T22:46:43.876 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77334.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.36810.log 2024-09-14T22:46:43.876 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.77334.log.gz 2024-09-14T22:46:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127634.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127634.log.gz 2024-09-14T22:46:43.877 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118812.log 2024-09-14T22:46:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36810.log.gz 2024-09-14T22:46:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39596.log 2024-09-14T22:46:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118812.log.gz 2024-09-14T22:46:43.878 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140754.log 2024-09-14T22:46:43.879 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39596.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39596.log.gz 2024-09-14T22:46:43.879 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69299.log 2024-09-14T22:46:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140754.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140754.log.gz 2024-09-14T22:46:43.880 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124358.log 2024-09-14T22:46:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69299.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97535.log 2024-09-14T22:46:43.881 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69299.log.gz 2024-09-14T22:46:43.881 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124358.log.gz 2024-09-14T22:46:43.882 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.84309.log 2024-09-14T22:46:43.883 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97535.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97535.log.gz 2024-09-14T22:46:43.883 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113586.log 2024-09-14T22:46:43.883 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.84309.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.84309.log.gz 2024-09-14T22:46:43.883 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37681.log 2024-09-14T22:46:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113586.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113586.log.gz 2024-09-14T22:46:43.884 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104513.log 2024-09-14T22:46:43.885 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37681.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37681.log.gz 2024-09-14T22:46:43.885 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83983.log 2024-09-14T22:46:43.886 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104513.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85689.log 0.0% 2024-09-14T22:46:43.886 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.104513.log.gz 2024-09-14T22:46:43.887 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83983.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52699.log 2024-09-14T22:46:43.887 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83983.log.gz 2024-09-14T22:46:43.888 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85689.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.85689.log.gz -5 2024-09-14T22:46:43.888 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.89155.log 2024-09-14T22:46:43.888 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52699.log.gz 2024-09-14T22:46:43.888 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53161.log 2024-09-14T22:46:43.889 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89155.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89155.log.gz 2024-09-14T22:46:43.890 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93234.log 2024-09-14T22:46:43.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53161.log.gz 2024-09-14T22:46:43.890 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.47067.log 2024-09-14T22:46:43.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93234.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147405.log 2024-09-14T22:46:43.890 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93234.log.gz 2024-09-14T22:46:43.891 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.47067.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.47067.log.gz 2024-09-14T22:46:43.891 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131715.log 2024-09-14T22:46:43.892 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147405.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.147405.log.gz -5 2024-09-14T22:46:43.892 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.99943.log 2024-09-14T22:46:43.893 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131715.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131715.log.gz 2024-09-14T22:46:43.893 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35753.log 2024-09-14T22:46:43.893 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99943.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99943.log.gz 2024-09-14T22:46:43.894 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41865.log 2024-09-14T22:46:43.894 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35753.log.gz 2024-09-14T22:46:43.894 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116926.log 2024-09-14T22:46:43.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41865.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41865.log.gz 2024-09-14T22:46:43.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104877.log 2024-09-14T22:46:43.896 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116926.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.116926.log.gz 2024-09-14T22:46:43.896 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38795.log 2024-09-14T22:46:43.897 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104877.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104877.log.gz 2024-09-14T22:46:43.897 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125996.log 2024-09-14T22:46:43.897 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38795.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38795.log.gz 2024-09-14T22:46:43.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94783.log 2024-09-14T22:46:43.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125996.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125996.log.gz 2024-09-14T22:46:43.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147445.log 2024-09-14T22:46:43.899 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94783.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94783.log.gz 2024-09-14T22:46:43.899 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139527.log 2024-09-14T22:46:43.900 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147445.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147445.log.gz 2024-09-14T22:46:43.900 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63880.log 2024-09-14T22:46:43.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139527.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84978.log 2024-09-14T22:46:43.901 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139527.log.gz 2024-09-14T22:46:43.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63880.log.gz 2024-09-14T22:46:43.902 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46839.log 2024-09-14T22:46:43.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84978.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84978.log.gz 2024-09-14T22:46:43.902 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114726.log 2024-09-14T22:46:43.903 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46839.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46839.log.gz 2024-09-14T22:46:43.903 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107866.log 2024-09-14T22:46:43.904 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114726.log.gz 2024-09-14T22:46:43.904 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48222.log 2024-09-14T22:46:43.905 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107866.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107866.log.gz 2024-09-14T22:46:43.905 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131330.log 2024-09-14T22:46:43.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48222.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52321.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131330.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42325.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52321.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52321.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34191.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42325.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42325.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54923.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34191.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34191.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73548.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54923.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54923.log.gz 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52784.log 2024-09-14T22:46:43.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73548.log.gz 2024-09-14T22:46:43.912 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50579.log 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52784.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52784.log.gz 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103639.log 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50579.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50579.log.gz 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127525.log 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103639.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103639.log.gz 2024-09-14T22:46:43.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110956.log 2024-09-14T22:46:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127525.log.gz 2024-09-14T22:46:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105902.log 2024-09-14T22:46:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110956.log.gz 2024-09-14T22:46:43.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35377.log 2024-09-14T22:46:43.915 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105902.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.105902.log.gz 2024-09-14T22:46:43.915 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.103992.log 2024-09-14T22:46:43.916 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35377.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35377.log.gz 2024-09-14T22:46:43.916 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149190.log 2024-09-14T22:46:43.917 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103992.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64674.log 2024-09-14T22:46:43.917 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103992.log.gz 2024-09-14T22:46:43.917 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149190.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149190.log.gz 2024-09-14T22:46:43.918 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91365.log 2024-09-14T22:46:43.918 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64674.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64674.log.gz 2024-09-14T22:46:43.918 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70051.log 2024-09-14T22:46:43.919 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91365.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91365.log.gz 2024-09-14T22:46:43.919 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.141708.log 2024-09-14T22:46:43.920 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70051.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster2-client.mirror.70051.log.gz 2024-09-14T22:46:43.920 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.88864.log 2024-09-14T22:46:43.921 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.141708.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.141708.log.gz 2024-09-14T22:46:43.921 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97760.log 2024-09-14T22:46:43.921 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88864.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88864.log.gz 2024-09-14T22:46:43.922 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121265.log 2024-09-14T22:46:43.922 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97760.log.gz 2024-09-14T22:46:43.922 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76115.log 2024-09-14T22:46:43.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121265.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121265.log.gz 2024-09-14T22:46:43.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52365.log 2024-09-14T22:46:43.924 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76115.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76115.log.gz 2024-09-14T22:46:43.924 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44696.log 2024-09-14T22:46:43.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52365.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52365.log.gz 2024-09-14T22:46:43.925 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149566.log 2024-09-14T22:46:43.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44696.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44696.log.gz 2024-09-14T22:46:43.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76324.log 2024-09-14T22:46:43.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149566.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149566.log.gz 2024-09-14T22:46:43.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37723.log 2024-09-14T22:46:43.927 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76324.log.gz 2024-09-14T22:46:43.927 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119532.log 2024-09-14T22:46:43.928 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37723.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37723.log.gz 2024-09-14T22:46:43.928 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152641.log 2024-09-14T22:46:43.928 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119532.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119532.log.gz 2024-09-14T22:46:43.929 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37871.log 2024-09-14T22:46:43.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152641.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152641.log.gz 2024-09-14T22:46:43.930 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80909.log 2024-09-14T22:46:43.930 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37871.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37871.log.gz 2024-09-14T22:46:43.930 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132226.log 2024-09-14T22:46:43.931 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80909.log.gz 2024-09-14T22:46:43.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60025.log 2024-09-14T22:46:43.932 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132226.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132226.log.gz 2024-09-14T22:46:43.932 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55421.log 2024-09-14T22:46:43.933 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60025.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.60025.log.gz 2024-09-14T22:46:43.933 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.55870.log 2024-09-14T22:46:43.933 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55421.log.gz 2024-09-14T22:46:43.934 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85228.log 2024-09-14T22:46:43.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55870.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55870.log.gz 2024-09-14T22:46:43.934 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112305.log 2024-09-14T22:46:43.935 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85228.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85228.log.gz 2024-09-14T22:46:43.935 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102826.log 2024-09-14T22:46:43.936 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112305.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112305.log.gz 2024-09-14T22:46:43.936 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143374.log 2024-09-14T22:46:43.937 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102826.log.gz 2024-09-14T22:46:43.937 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64989.log 2024-09-14T22:46:43.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143374.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143374.log.gz 2024-09-14T22:46:43.938 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76429.log 2024-09-14T22:46:43.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64989.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64989.log.gz 2024-09-14T22:46:43.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124589.log 2024-09-14T22:46:43.939 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76429.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76429.log.gz 2024-09-14T22:46:43.939 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100049.log 2024-09-14T22:46:43.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124589.log.gz 2024-09-14T22:46:43.940 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123098.log 2024-09-14T22:46:43.941 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100049.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100049.log.gz 2024-09-14T22:46:43.941 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153847.log 2024-09-14T22:46:43.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123098.log.gz 2024-09-14T22:46:43.942 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37535.log 2024-09-14T22:46:43.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153847.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38374.log 2024-09-14T22:46:43.943 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153847.log.gz 2024-09-14T22:46:43.943 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37535.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37535.log.gz 2024-09-14T22:46:43.943 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81980.log 2024-09-14T22:46:43.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38374.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.38374.log.gz --verbose 2024-09-14T22:46:43.944 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.74682.log 2024-09-14T22:46:43.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81980.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81980.log.gz 2024-09-14T22:46:43.945 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133905.log 2024-09-14T22:46:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74682.log.gz 2024-09-14T22:46:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75023.log 2024-09-14T22:46:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133905.log.gz 2024-09-14T22:46:43.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36330.log 2024-09-14T22:46:43.947 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75023.log.gz 2024-09-14T22:46:43.947 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143683.log 2024-09-14T22:46:43.948 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36330.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67566.log 2024-09-14T22:46:43.948 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36330.log.gz 2024-09-14T22:46:43.948 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143683.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143683.log.gz 2024-09-14T22:46:43.949 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49818.log 2024-09-14T22:46:43.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67566.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117285.log 2024-09-14T22:46:43.949 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67566.log.gz 2024-09-14T22:46:43.950 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49818.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.admin.80910.log 2024-09-14T22:46:43.950 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.49818.log.gz 2024-09-14T22:46:43.951 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117285.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117285.log.gz 2024-09-14T22:46:43.951 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110035.log 2024-09-14T22:46:43.951 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80910.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80910.log.gz 2024-09-14T22:46:43.952 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95510.log 2024-09-14T22:46:43.952 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110035.log.gz 2024-09-14T22:46:43.952 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135172.log 2024-09-14T22:46:43.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95510.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95510.log.gz 2024-09-14T22:46:43.953 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141413.log 2024-09-14T22:46:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135172.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135172.log.gz 2024-09-14T22:46:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140378.log 2024-09-14T22:46:43.954 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141413.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141413.log.gz -5 2024-09-14T22:46:43.954 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.107668.log 2024-09-14T22:46:43.955 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140378.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140378.log.gz 2024-09-14T22:46:43.955 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47088.log 2024-09-14T22:46:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107668.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107668.log.gz 2024-09-14T22:46:43.956 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.56489.log 2024-09-14T22:46:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47088.log.gz 2024-09-14T22:46:43.957 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132288.log 2024-09-14T22:46:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.56489.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.56489.log.gz 2024-09-14T22:46:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148938.log 2024-09-14T22:46:43.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132288.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132288.log.gz 2024-09-14T22:46:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130690.log 2024-09-14T22:46:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148938.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148938.log.gz 2024-09-14T22:46:43.959 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54507.log 2024-09-14T22:46:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130690.log.gz 2024-09-14T22:46:43.960 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138401.log 2024-09-14T22:46:43.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54507.log.gz 2024-09-14T22:46:43.961 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71993.log 2024-09-14T22:46:43.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138401.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82363.log 2024-09-14T22:46:43.961 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138401.log.gz 2024-09-14T22:46:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71993.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71993.log.gz 2024-09-14T22:46:43.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130332.log 2024-09-14T22:46:43.963 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82363.log.gz 2024-09-14T22:46:43.963 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151013.log 2024-09-14T22:46:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130332.log.gz 2024-09-14T22:46:43.964 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.117881.log 2024-09-14T22:46:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151013.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.admin.151013.log.gz 2024-09-14T22:46:43.965 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.62110.log 2024-09-14T22:46:43.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.117881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.117881.log.gz 2024-09-14T22:46:43.966 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.93055.log 2024-09-14T22:46:43.966 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62110.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62110.log.gz 2024-09-14T22:46:43.966 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146671.log 2024-09-14T22:46:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.93055.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.93055.log.gz 2024-09-14T22:46:43.967 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102825.log 2024-09-14T22:46:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146671.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146671.log.gz 2024-09-14T22:46:43.968 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84551.log 2024-09-14T22:46:43.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102825.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102825.log.gz 2024-09-14T22:46:43.969 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37725.log 2024-09-14T22:46:43.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84551.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84551.log.gz 2024-09-14T22:46:43.969 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40058.log 2024-09-14T22:46:43.970 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37725.log.gz 2024-09-14T22:46:43.970 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118565.log 2024-09-14T22:46:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40058.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40058.log.gz 2024-09-14T22:46:43.971 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145051.log 2024-09-14T22:46:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118565.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118565.log.gz 2024-09-14T22:46:43.972 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147744.log 2024-09-14T22:46:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145051.log.gz 2024-09-14T22:46:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70575.log 2024-09-14T22:46:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147744.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147744.log.gz 2024-09-14T22:46:43.973 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84809.log 2024-09-14T22:46:43.974 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70575.log.gz 2024-09-14T22:46:43.974 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83066.log 2024-09-14T22:46:43.975 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84809.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84245.log 2024-09-14T22:46:43.975 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84809.log.gz 2024-09-14T22:46:43.976 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83066.log.gz 2024-09-14T22:46:43.976 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100406.log 2024-09-14T22:46:43.976 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84245.log.gz 2024-09-14T22:46:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46362.log 2024-09-14T22:46:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100406.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100406.log.gz 2024-09-14T22:46:43.977 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116345.log 2024-09-14T22:46:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46362.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46362.log.gz 2024-09-14T22:46:43.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151189.log 2024-09-14T22:46:43.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116345.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116345.log.gz 2024-09-14T22:46:43.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39216.log 2024-09-14T22:46:43.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151189.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.admin.151189.log.gz -- 2024-09-14T22:46:43.980 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.114581.log 2024-09-14T22:46:43.980 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39216.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39216.log.gz 2024-09-14T22:46:43.980 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93887.log 2024-09-14T22:46:43.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114581.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114581.log.gz 2024-09-14T22:46:43.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45298.log 2024-09-14T22:46:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93887.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93887.log.gz 2024-09-14T22:46:43.982 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66963.log 2024-09-14T22:46:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45298.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45298.log.gz 2024-09-14T22:46:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100114.log 2024-09-14T22:46:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66963.log.gz 2024-09-14T22:46:43.983 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142029.log 2024-09-14T22:46:43.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100114.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.100114.log.gz --verbose 2024-09-14T22:46:43.984 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.90167.log 2024-09-14T22:46:43.985 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142029.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142029.log.gz 2024-09-14T22:46:43.985 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44035.log 2024-09-14T22:46:43.986 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90167.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90167.log.gz 2024-09-14T22:46:43.986 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129364.log 2024-09-14T22:46:43.986 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44035.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44035.log.gz 2024-09-14T22:46:43.986 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77815.log 2024-09-14T22:46:43.987 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129364.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.129364.log.gz 2024-09-14T22:46:43.987 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.92372.log 2024-09-14T22:46:43.988 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77815.log.gz 2024-09-14T22:46:43.988 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62912.log 2024-09-14T22:46:43.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92372.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93121.log 2024-09-14T22:46:43.989 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92372.log.gz 2024-09-14T22:46:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62912.log.gz 2024-09-14T22:46:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132981.log 2024-09-14T22:46:43.990 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93121.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93121.log.gz 2024-09-14T22:46:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105776.log 2024-09-14T22:46:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132981.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132981.log.gz 2024-09-14T22:46:43.991 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139927.log 2024-09-14T22:46:43.992 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105776.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138869.log 2024-09-14T22:46:43.992 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105776.log.gz 2024-09-14T22:46:43.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139927.log.gz 2024-09-14T22:46:43.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94596.log 2024-09-14T22:46:43.994 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138869.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138869.log.gz 2024-09-14T22:46:43.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86761.log 2024-09-14T22:46:43.994 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94596.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94596.log.gz 2024-09-14T22:46:43.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85061.log 2024-09-14T22:46:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86761.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86761.log.gz 2024-09-14T22:46:43.995 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.35161.log 2024-09-14T22:46:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85061.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85061.log.gz 2024-09-14T22:46:43.996 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98367.log 2024-09-14T22:46:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.35161.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.35161.log.gz 2024-09-14T22:46:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48574.log 2024-09-14T22:46:43.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98367.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98367.log.gz -5 2024-09-14T22:46:43.997 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.53959.log 2024-09-14T22:46:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48574.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48574.log.gz 2024-09-14T22:46:43.998 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81284.log 2024-09-14T22:46:43.999 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53959.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53959.log.gz 2024-09-14T22:46:43.999 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96384.log 2024-09-14T22:46:44.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81284.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81284.log.gz 2024-09-14T22:46:44.000 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59657.log 2024-09-14T22:46:44.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96384.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96384.log.gz 2024-09-14T22:46:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100697.log 2024-09-14T22:46:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59657.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59657.log.gz 2024-09-14T22:46:44.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74434.log 2024-09-14T22:46:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100697.log.gz 2024-09-14T22:46:44.002 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78176.log 2024-09-14T22:46:44.003 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74434.log.gz 2024-09-14T22:46:44.003 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137506.log 2024-09-14T22:46:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78176.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78176.log.gz 2024-09-14T22:46:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153687.log 2024-09-14T22:46:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137506.log.gz 2024-09-14T22:46:44.004 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117673.log 2024-09-14T22:46:44.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153687.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.41920.log -- replaced with /var/log/ceph/cluster1-client.admin.153687.log.gz 2024-09-14T22:46:44.005 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117673.log.gz 2024-09-14T22:46:44.006 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96666.log 2024-09-14T22:46:44.007 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41920.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41920.log.gz 2024-09-14T22:46:44.007 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70803.log 2024-09-14T22:46:44.007 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96666.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96666.log.gz 2024-09-14T22:46:44.008 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101791.log 2024-09-14T22:46:44.008 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70803.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.105882.log 2024-09-14T22:46:44.008 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.70803.log.gz 2024-09-14T22:46:44.009 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101791.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101791.log.gz 2024-09-14T22:46:44.009 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98724.log 2024-09-14T22:46:44.010 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.105882.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.105882.log.gz 2024-09-14T22:46:44.010 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77162.log 2024-09-14T22:46:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98724.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.98724.log.gz 2024-09-14T22:46:44.011 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85691.log 2024-09-14T22:46:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77162.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77162.log.gz 2024-09-14T22:46:44.011 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118357.log 2024-09-14T22:46:44.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85691.log.gz 2024-09-14T22:46:44.012 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154701.log 2024-09-14T22:46:44.013 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118357.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118357.log.gz 2024-09-14T22:46:44.013 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53163.log 2024-09-14T22:46:44.014 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154701.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154701.log.gz 2024-09-14T22:46:44.014 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83103.log 2024-09-14T22:46:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53163.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53163.log.gz 2024-09-14T22:46:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95793.log 2024-09-14T22:46:44.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83103.log.gz 2024-09-14T22:46:44.016 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70165.log 2024-09-14T22:46:44.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95793.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.95793.log.gz /var/log/ceph/cluster1-client.admin.119892.log 2024-09-14T22:46:44.016 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70165.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70165.log.gz 2024-09-14T22:46:44.017 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122110.log 2024-09-14T22:46:44.018 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119892.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119892.log.gz 2024-09-14T22:46:44.018 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79764.log 2024-09-14T22:46:44.019 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122110.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122110.log.gz 2024-09-14T22:46:44.019 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115440.log 2024-09-14T22:46:44.020 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79764.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79764.log.gz 2024-09-14T22:46:44.020 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138794.log 2024-09-14T22:46:44.021 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115440.log.gz 2024-09-14T22:46:44.021 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117901.log 2024-09-14T22:46:44.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138794.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138794.log.gz 2024-09-14T22:46:44.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109742.log 2024-09-14T22:46:44.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117901.log.gz 2024-09-14T22:46:44.023 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105750.log 2024-09-14T22:46:44.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109742.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109742.log.gz 2024-09-14T22:46:44.024 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81103.log 2024-09-14T22:46:44.024 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105750.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105750.log.gz 2024-09-14T22:46:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133662.log 2024-09-14T22:46:44.025 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81103.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81103.log.gz 2024-09-14T22:46:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84769.log 2024-09-14T22:46:44.026 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133662.log.gz 2024-09-14T22:46:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152287.log 2024-09-14T22:46:44.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84769.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84769.log.gz 2024-09-14T22:46:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98683.log 2024-09-14T22:46:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152287.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152287.log.gz 2024-09-14T22:46:44.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122595.log 2024-09-14T22:46:44.029 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98683.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98683.log.gz 2024-09-14T22:46:44.029 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110494.log 2024-09-14T22:46:44.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122595.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122595.log.gz 2024-09-14T22:46:44.030 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66038.log 2024-09-14T22:46:44.031 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110494.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110494.log.gz 2024-09-14T22:46:44.031 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93319.log 2024-09-14T22:46:44.032 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66038.log.gz 2024-09-14T22:46:44.032 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59695.log 2024-09-14T22:46:44.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93319.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93319.log.gz 2024-09-14T22:46:44.033 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117648.log 2024-09-14T22:46:44.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59695.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59695.log.gz 2024-09-14T22:46:44.033 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64713.log 2024-09-14T22:46:44.034 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117648.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117648.log.gz 2024-09-14T22:46:44.034 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77819.log 2024-09-14T22:46:44.035 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64713.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64713.log.gz 2024-09-14T22:46:44.035 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106841.log 2024-09-14T22:46:44.036 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77819.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77819.log.gz 2024-09-14T22:46:44.036 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63665.log 2024-09-14T22:46:44.036 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106841.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106841.log.gz 2024-09-14T22:46:44.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69308.log 2024-09-14T22:46:44.037 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63665.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63665.log.gz 2024-09-14T22:46:44.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103771.log 2024-09-14T22:46:44.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69308.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69308.log.gz 2024-09-14T22:46:44.038 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111967.log 2024-09-14T22:46:44.039 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103771.log.gz 2024-09-14T22:46:44.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132393.log 2024-09-14T22:46:44.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111967.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111967.log.gz 2024-09-14T22:46:44.040 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.35221.log 2024-09-14T22:46:44.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132393.log.gz 2024-09-14T22:46:44.040 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.151677.log 2024-09-14T22:46:44.041 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.35221.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148853.log 0.0% 2024-09-14T22:46:44.041 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.35221.log.gz 2024-09-14T22:46:44.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.151677.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.151677.log.gz 2024-09-14T22:46:44.042 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46907.log 2024-09-14T22:46:44.043 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148853.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.148853.log.gz 2024-09-14T22:46:44.043 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39427.log 2024-09-14T22:46:44.043 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46907.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.80245.log 2024-09-14T22:46:44.044 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46907.log.gz 2024-09-14T22:46:44.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39427.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.42157.log 2024-09-14T22:46:44.044 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.39427.log.gz 2024-09-14T22:46:44.045 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.80245.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.80245.log.gz 2024-09-14T22:46:44.045 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102922.log 2024-09-14T22:46:44.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42157.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42157.log.gz 2024-09-14T22:46:44.046 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78936.log 2024-09-14T22:46:44.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102922.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102922.log.gz 2024-09-14T22:46:44.047 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47727.log 2024-09-14T22:46:44.047 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78936.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59722.log 2024-09-14T22:46:44.047 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78936.log.gz 2024-09-14T22:46:44.048 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47727.log.gz 2024-09-14T22:46:44.048 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114673.log 2024-09-14T22:46:44.049 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59722.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59722.log.gz -5 2024-09-14T22:46:44.049 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.42241.log 2024-09-14T22:46:44.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114673.log.gz 2024-09-14T22:46:44.050 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98009.log 2024-09-14T22:46:44.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42241.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.42241.log.gz -5 2024-09-14T22:46:44.050 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.148540.log 2024-09-14T22:46:44.051 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98009.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98009.log.gz 2024-09-14T22:46:44.051 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110137.log 2024-09-14T22:46:44.052 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148540.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148540.log.gz 2024-09-14T22:46:44.052 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109423.log 2024-09-14T22:46:44.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110137.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110137.log.gz 2024-09-14T22:46:44.053 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122239.log 2024-09-14T22:46:44.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109423.log.gz 2024-09-14T22:46:44.054 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87221.log 2024-09-14T22:46:44.054 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122239.log.gz 2024-09-14T22:46:44.054 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88482.log 2024-09-14T22:46:44.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87221.log.gz 2024-09-14T22:46:44.055 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148960.log 2024-09-14T22:46:44.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88482.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88482.log.gz 2024-09-14T22:46:44.056 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74393.log 2024-09-14T22:46:44.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148960.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148960.log.gz 2024-09-14T22:46:44.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139789.log 2024-09-14T22:46:44.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74393.log.gz 2024-09-14T22:46:44.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97023.log 2024-09-14T22:46:44.058 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139789.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139789.log.gz -5 2024-09-14T22:46:44.058 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.37578.log 2024-09-14T22:46:44.059 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97023.log.gz 2024-09-14T22:46:44.059 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42546.log 2024-09-14T22:46:44.060 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37578.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37578.log.gz 2024-09-14T22:46:44.060 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135384.log 2024-09-14T22:46:44.060 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42546.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42546.log.gz 2024-09-14T22:46:44.061 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121901.log 2024-09-14T22:46:44.061 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135384.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135384.log.gz 2024-09-14T22:46:44.061 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120703.log 2024-09-14T22:46:44.062 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121901.log.gz 2024-09-14T22:46:44.062 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73236.log 2024-09-14T22:46:44.063 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120703.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120703.log.gz 2024-09-14T22:46:44.063 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120534.log 2024-09-14T22:46:44.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73236.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73236.log.gz 2024-09-14T22:46:44.064 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73823.log 2024-09-14T22:46:44.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120534.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120534.log.gz 2024-09-14T22:46:44.064 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129496.log 2024-09-14T22:46:44.065 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73823.log.gz 2024-09-14T22:46:44.065 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97503.log 2024-09-14T22:46:44.066 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129496.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40122.log 2024-09-14T22:46:44.066 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129496.log.gz 2024-09-14T22:46:44.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97503.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97503.log.gz 2024-09-14T22:46:44.067 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99207.log 2024-09-14T22:46:44.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40122.log.gz 2024-09-14T22:46:44.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112806.log 2024-09-14T22:46:44.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99207.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99207.log.gz 2024-09-14T22:46:44.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94918.log 2024-09-14T22:46:44.069 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112806.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112806.log.gz 2024-09-14T22:46:44.069 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150267.log 2024-09-14T22:46:44.070 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94918.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94918.log.gz 2024-09-14T22:46:44.070 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134052.log 2024-09-14T22:46:44.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150267.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150267.log.gz 2024-09-14T22:46:44.071 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151544.log 2024-09-14T22:46:44.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134052.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134052.log.gz 2024-09-14T22:46:44.072 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123940.log 2024-09-14T22:46:44.072 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151544.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151544.log.gz 2024-09-14T22:46:44.072 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74263.log 2024-09-14T22:46:44.073 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123940.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50117.log 2024-09-14T22:46:44.073 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123940.log.gz 2024-09-14T22:46:44.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74263.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74263.log.gz 2024-09-14T22:46:44.074 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40379.log 2024-09-14T22:46:44.075 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50117.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50117.log.gz 2024-09-14T22:46:44.075 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130446.log 2024-09-14T22:46:44.075 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40379.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40379.log.gz 2024-09-14T22:46:44.076 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113587.log 2024-09-14T22:46:44.076 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130446.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130446.log.gz 2024-09-14T22:46:44.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122198.log 2024-09-14T22:46:44.077 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113587.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113587.log.gz 2024-09-14T22:46:44.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132751.log 2024-09-14T22:46:44.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122198.log.gz 2024-09-14T22:46:44.078 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100889.log 2024-09-14T22:46:44.079 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132751.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126425.log 2024-09-14T22:46:44.079 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132751.log.gz 2024-09-14T22:46:44.080 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100889.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.65094.log -- replaced with /var/log/ceph/cluster1-client.mirror.100889.log.gz 2024-09-14T22:46:44.080 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126425.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126425.log.gz 2024-09-14T22:46:44.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107496.log 2024-09-14T22:46:44.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65094.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65094.log.gz 2024-09-14T22:46:44.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106472.log 2024-09-14T22:46:44.082 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107496.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.107496.log.gz /var/log/ceph/cluster1-client.mirror.99103.log 2024-09-14T22:46:44.082 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.083 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106472.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106472.log.gz 2024-09-14T22:46:44.083 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108483.log 2024-09-14T22:46:44.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99103.log.gz 2024-09-14T22:46:44.084 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146544.log 2024-09-14T22:46:44.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108483.log.gz 2024-09-14T22:46:44.085 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66846.log 2024-09-14T22:46:44.085 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146544.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135004.log 2024-09-14T22:46:44.085 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146544.log.gz 2024-09-14T22:46:44.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66846.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66846.log.gz 2024-09-14T22:46:44.086 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120143.log 2024-09-14T22:46:44.087 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135004.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135004.log.gz 2024-09-14T22:46:44.087 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65660.log 2024-09-14T22:46:44.088 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120143.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120143.log.gz 2024-09-14T22:46:44.088 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119750.log 2024-09-14T22:46:44.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65660.log.gz 2024-09-14T22:46:44.089 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95378.log 2024-09-14T22:46:44.090 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119750.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119750.log.gz 2024-09-14T22:46:44.091 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110604.log 2024-09-14T22:46:44.091 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95378.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95378.log.gz 2024-09-14T22:46:44.091 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147743.log 2024-09-14T22:46:44.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110604.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110604.log.gz 2024-09-14T22:46:44.092 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.143137.log 2024-09-14T22:46:44.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147743.log.gz 2024-09-14T22:46:44.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106385.log 2024-09-14T22:46:44.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.143137.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.143137.log.gz 2024-09-14T22:46:44.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94026.log 2024-09-14T22:46:44.094 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106385.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106385.log.gz 2024-09-14T22:46:44.094 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99417.log 2024-09-14T22:46:44.095 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94026.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94026.log.gz 2024-09-14T22:46:44.095 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65198.log 2024-09-14T22:46:44.096 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99417.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99417.log.gz 2024-09-14T22:46:44.096 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70917.log 2024-09-14T22:46:44.097 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65198.log.gz 2024-09-14T22:46:44.097 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131658.log 2024-09-14T22:46:44.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70917.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70917.log.gz 2024-09-14T22:46:44.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125598.log 2024-09-14T22:46:44.099 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131658.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131658.log.gz 2024-09-14T22:46:44.099 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118182.log 2024-09-14T22:46:44.100 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125598.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125598.log.gz 2024-09-14T22:46:44.100 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97925.log 2024-09-14T22:46:44.100 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118182.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118182.log.gz 2024-09-14T22:46:44.101 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109300.log 2024-09-14T22:46:44.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97925.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97925.log.gz 2024-09-14T22:46:44.102 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69547.log 2024-09-14T22:46:44.102 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109300.log.gz 2024-09-14T22:46:44.103 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85062.log 2024-09-14T22:46:44.103 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69547.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69547.log.gz 2024-09-14T22:46:44.104 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99104.log 2024-09-14T22:46:44.104 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85062.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85062.log.gz 2024-09-14T22:46:44.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114255.log 2024-09-14T22:46:44.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99104.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99104.log.gz 2024-09-14T22:46:44.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107497.log 2024-09-14T22:46:44.106 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114255.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.114255.log.gz -5 2024-09-14T22:46:44.106 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.86465.log 2024-09-14T22:46:44.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107497.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.107497.log.gz --verbose 2024-09-14T22:46:44.107 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.111780.log 2024-09-14T22:46:44.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86465.log.gz 2024-09-14T22:46:44.108 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77542.log 2024-09-14T22:46:44.108 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111780.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111780.log.gz 2024-09-14T22:46:44.108 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112431.log 2024-09-14T22:46:44.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77542.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77542.log.gz 2024-09-14T22:46:44.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151722.log 2024-09-14T22:46:44.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112431.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112431.log.gz 2024-09-14T22:46:44.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77079.log 2024-09-14T22:46:44.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151722.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151722.log.gz 2024-09-14T22:46:44.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77753.log 2024-09-14T22:46:44.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77079.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104708.log 2024-09-14T22:46:44.111 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77079.log.gz 2024-09-14T22:46:44.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77753.log.gz 2024-09-14T22:46:44.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141322.log 2024-09-14T22:46:44.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104708.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104708.log.gz 2024-09-14T22:46:44.113 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103573.log 2024-09-14T22:46:44.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141322.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141322.log.gz 2024-09-14T22:46:44.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149085.log 2024-09-14T22:46:44.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103573.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.103573.log.gz 2024-09-14T22:46:44.115 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132544.log 2024-09-14T22:46:44.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149085.log.gz 2024-09-14T22:46:44.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133588.log 2024-09-14T22:46:44.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132544.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132544.log.gz 2024-09-14T22:46:44.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.143290.log 2024-09-14T22:46:44.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133588.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76702.log 2024-09-14T22:46:44.117 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133588.log.gz 2024-09-14T22:46:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.143290.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.143290.log.gz 2024-09-14T22:46:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127304.log 2024-09-14T22:46:44.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76702.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76702.log.gz 2024-09-14T22:46:44.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78173.log 2024-09-14T22:46:44.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127304.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127304.log.gz 2024-09-14T22:46:44.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84851.log 2024-09-14T22:46:44.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78173.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92230.log 2024-09-14T22:46:44.120 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78173.log.gz 2024-09-14T22:46:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84851.log.gz 2024-09-14T22:46:44.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82296.log 2024-09-14T22:46:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92230.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92230.log.gz 2024-09-14T22:46:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144447.log 2024-09-14T22:46:44.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82296.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82296.log.gz 2024-09-14T22:46:44.123 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151800.log 2024-09-14T22:46:44.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144447.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144447.log.gz 2024-09-14T22:46:44.124 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120366.log 2024-09-14T22:46:44.124 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151800.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151800.log.gz 2024-09-14T22:46:44.125 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140758.log 2024-09-14T22:46:44.125 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120366.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120366.log.gz 2024-09-14T22:46:44.125 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97318.log 2024-09-14T22:46:44.126 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140758.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140758.log.gz 2024-09-14T22:46:44.126 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98242.log 2024-09-14T22:46:44.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97318.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97318.log.gz 2024-09-14T22:46:44.127 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120144.log 2024-09-14T22:46:44.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98242.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98242.log.gz 2024-09-14T22:46:44.128 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110034.log 2024-09-14T22:46:44.129 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120144.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120144.log.gz 2024-09-14T22:46:44.130 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87179.log 2024-09-14T22:46:44.130 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110034.log.gz 2024-09-14T22:46:44.130 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76960.log 2024-09-14T22:46:44.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87179.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87179.log.gz 2024-09-14T22:46:44.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139981.log 2024-09-14T22:46:44.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76960.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76960.log.gz 2024-09-14T22:46:44.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131832.log 2024-09-14T22:46:44.133 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139981.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139981.log.gz 2024-09-14T22:46:44.133 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133698.log 2024-09-14T22:46:44.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131832.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131832.log.gz 2024-09-14T22:46:44.134 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96878.log 2024-09-14T22:46:44.135 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133698.log.gz 2024-09-14T22:46:44.135 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103507.log 2024-09-14T22:46:44.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96878.log.gz 2024-09-14T22:46:44.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96073.log 2024-09-14T22:46:44.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103507.log.gz 2024-09-14T22:46:44.137 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143762.log 2024-09-14T22:46:44.137 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96073.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96073.log.gz 2024-09-14T22:46:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106944.log 2024-09-14T22:46:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143762.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143762.log.gz 2024-09-14T22:46:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151037.log 2024-09-14T22:46:44.139 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106944.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106944.log.gz 2024-09-14T22:46:44.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68709.log 2024-09-14T22:46:44.140 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151037.log.gz 2024-09-14T22:46:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103462.log 2024-09-14T22:46:44.141 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68709.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68709.log.gz 2024-09-14T22:46:44.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46611.log 2024-09-14T22:46:44.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103462.log.gz 2024-09-14T22:46:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129121.log 2024-09-14T22:46:44.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46611.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46611.log.gz 2024-09-14T22:46:44.144 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142184.log 2024-09-14T22:46:44.144 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129121.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129121.log.gz 2024-09-14T22:46:44.144 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73029.log 2024-09-14T22:46:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142184.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142184.log.gz 2024-09-14T22:46:44.145 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77754.log 2024-09-14T22:46:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73029.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73029.log.gz 2024-09-14T22:46:44.146 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102735.log 2024-09-14T22:46:44.147 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77754.log.gz 2024-09-14T22:46:44.147 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128790.log 2024-09-14T22:46:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102735.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102735.log.gz 2024-09-14T22:46:44.148 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53852.log 2024-09-14T22:46:44.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128790.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128790.log.gz 2024-09-14T22:46:44.152 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108753.log 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53852.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53852.log.gz 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89324.log 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108753.log.gz 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52576.log 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89324.log.gz 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69913.log 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52576.log.gz 2024-09-14T22:46:44.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65514.log 2024-09-14T22:46:44.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69913.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69913.log.gz 2024-09-14T22:46:44.155 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.103013.log 2024-09-14T22:46:44.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65514.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65514.log.gz 2024-09-14T22:46:44.156 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147593.log 2024-09-14T22:46:44.156 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.103013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.103013.log.gz 2024-09-14T22:46:44.156 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146648.log 2024-09-14T22:46:44.156 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147593.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147593.log.gz 2024-09-14T22:46:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97231.log 2024-09-14T22:46:44.157 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146648.log.gz 2024-09-14T22:46:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86591.log 2024-09-14T22:46:44.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97231.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97231.log.gz 2024-09-14T22:46:44.159 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114886.log 2024-09-14T22:46:44.159 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86591.log.gz 2024-09-14T22:46:44.159 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42865.log 2024-09-14T22:46:44.160 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114886.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114886.log.gz 2024-09-14T22:46:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2.audit.log 2024-09-14T22:46:44.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42865.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42865.log.gz 2024-09-14T22:46:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142767.log 2024-09-14T22:46:44.162 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2.audit.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130157.log 2024-09-14T22:46:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142767.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142767.log.gz 2024-09-14T22:46:44.163 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65513.log 2024-09-14T22:46:44.164 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130157.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130157.log.gz 2024-09-14T22:46:44.164 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102044.log 2024-09-14T22:46:44.165 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65513.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65513.log.gz 2024-09-14T22:46:44.165 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147700.log 2024-09-14T22:46:44.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102044.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102044.log.gz 2024-09-14T22:46:44.166 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124375.log 2024-09-14T22:46:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147700.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147700.log.gz 2024-09-14T22:46:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140819.log 2024-09-14T22:46:44.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124375.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124375.log.gz 2024-09-14T22:46:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126018.log 2024-09-14T22:46:44.168 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140819.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140819.log.gz 2024-09-14T22:46:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68345.log 2024-09-14T22:46:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126018.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126018.log.gz 2024-09-14T22:46:44.170 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63698.log 2024-09-14T22:46:44.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68345.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68345.log.gz 2024-09-14T22:46:44.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61648.log 2024-09-14T22:46:44.171 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63698.log.gz 2024-09-14T22:46:44.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150351.log 2024-09-14T22:46:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61648.log.gz 2024-09-14T22:46:44.172 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80219.log 2024-09-14T22:46:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150351.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150351.log.gz 2024-09-14T22:46:44.173 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124061.log 2024-09-14T22:46:44.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80219.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80219.log.gz -5 2024-09-14T22:46:44.174 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.153459.log 2024-09-14T22:46:44.175 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124061.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124061.log.gz 2024-09-14T22:46:44.175 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45882.log 2024-09-14T22:46:44.175 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153459.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86677.log 2024-09-14T22:46:44.175 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153459.log.gz 2024-09-14T22:46:44.176 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45882.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45882.log.gz 2024-09-14T22:46:44.176 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73174.log 2024-09-14T22:46:44.177 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86677.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.86677.log.gz 2024-09-14T22:46:44.177 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.80094.log 2024-09-14T22:46:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73174.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73174.log.gz 2024-09-14T22:46:44.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101750.log 2024-09-14T22:46:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80094.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131437.log 2024-09-14T22:46:44.179 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80094.log.gz 2024-09-14T22:46:44.179 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101750.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124736.log 2024-09-14T22:46:44.179 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101750.log.gz 2024-09-14T22:46:44.180 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131437.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131437.log.gz 2024-09-14T22:46:44.180 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49005.log 2024-09-14T22:46:44.181 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124736.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148015.log 2024-09-14T22:46:44.181 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124736.log.gz 2024-09-14T22:46:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49005.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49005.log.gz 2024-09-14T22:46:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69549.log 2024-09-14T22:46:44.182 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148015.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.148015.log.gz 2024-09-14T22:46:44.182 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.106130.log 2024-09-14T22:46:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69549.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69549.log.gz 2024-09-14T22:46:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70601.log 2024-09-14T22:46:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106130.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106130.log.gz 2024-09-14T22:46:44.184 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131483.log 2024-09-14T22:46:44.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70601.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70601.log.gz 2024-09-14T22:46:44.185 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61148.log 2024-09-14T22:46:44.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131483.log.gz 2024-09-14T22:46:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65809.log 2024-09-14T22:46:44.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61148.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61148.log.gz 2024-09-14T22:46:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98616.log 2024-09-14T22:46:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65809.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65809.log.gz 2024-09-14T22:46:44.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117321.log 2024-09-14T22:46:44.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79632.log 2024-09-14T22:46:44.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98616.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98616.log.gz 2024-09-14T22:46:44.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117321.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117321.log.gz 2024-09-14T22:46:44.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135976.log 2024-09-14T22:46:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79632.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79632.log.gz 2024-09-14T22:46:44.190 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48706.log 2024-09-14T22:46:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135976.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135976.log.gz 2024-09-14T22:46:44.191 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37639.log 2024-09-14T22:46:44.192 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48706.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42720.log 2024-09-14T22:46:44.192 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48706.log.gz 2024-09-14T22:46:44.192 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37639.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37639.log.gz 2024-09-14T22:46:44.192 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128236.log 2024-09-14T22:46:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42720.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42720.log.gz 2024-09-14T22:46:44.193 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84423.log 2024-09-14T22:46:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128236.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89487.log 2024-09-14T22:46:44.194 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128236.log.gz 2024-09-14T22:46:44.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84423.log.gz 2024-09-14T22:46:44.195 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76175.log 2024-09-14T22:46:44.195 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89487.log: 92.6% -- replaced with /var/log/ceph/cluster2.audit.log.gz 2024-09-14T22:46:44.195 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89487.log.gz 2024-09-14T22:46:44.195 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45993.log 2024-09-14T22:46:44.196 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76175.log.gz 2024-09-14T22:46:44.196 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110790.log 2024-09-14T22:46:44.197 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45993.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.45993.log.gz -5 2024-09-14T22:46:44.197 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.123517.log 2024-09-14T22:46:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110790.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110790.log.gz 2024-09-14T22:46:44.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37474.log 2024-09-14T22:46:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123517.log.gz 2024-09-14T22:46:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68008.log 2024-09-14T22:46:44.199 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37474.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79896.log 2024-09-14T22:46:44.199 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37474.log.gz 2024-09-14T22:46:44.200 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68008.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68008.log.gz 2024-09-14T22:46:44.200 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88061.log 2024-09-14T22:46:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79896.log.gz 2024-09-14T22:46:44.201 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83789.log 2024-09-14T22:46:44.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88061.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132709.log 2024-09-14T22:46:44.202 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88061.log.gz 2024-09-14T22:46:44.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83789.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83789.log.gz 2024-09-14T22:46:44.203 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50685.log 2024-09-14T22:46:44.203 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132709.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132709.log.gz 2024-09-14T22:46:44.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50097.log 2024-09-14T22:46:44.204 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50685.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50685.log.gz 2024-09-14T22:46:44.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71226.log 2024-09-14T22:46:44.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50097.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50097.log.gz 2024-09-14T22:46:44.205 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73403.log 2024-09-14T22:46:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71226.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71226.log.gz 2024-09-14T22:46:44.206 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108754.log 2024-09-14T22:46:44.207 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73403.log.gz 2024-09-14T22:46:44.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122741.log 2024-09-14T22:46:44.207 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108754.log.gz 2024-09-14T22:46:44.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131179.log 2024-09-14T22:46:44.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122741.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122741.log.gz 2024-09-14T22:46:44.208 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83878.log 2024-09-14T22:46:44.209 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131179.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131179.log.gz 2024-09-14T22:46:44.209 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116169.log 2024-09-14T22:46:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83878.log.gz 2024-09-14T22:46:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120847.log 2024-09-14T22:46:44.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116169.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116169.log.gz -5 2024-09-14T22:46:44.210 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.132813.log 2024-09-14T22:46:44.211 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120847.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120847.log.gz 2024-09-14T22:46:44.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113434.log 2024-09-14T22:46:44.212 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132813.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132813.log.gz 2024-09-14T22:46:44.212 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80267.log 2024-09-14T22:46:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113434.log.gz 2024-09-14T22:46:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53875.log 2024-09-14T22:46:44.213 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80267.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118042.log 2024-09-14T22:46:44.213 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80267.log.gz 2024-09-14T22:46:44.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53875.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53875.log.gz 2024-09-14T22:46:44.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75862.log 2024-09-14T22:46:44.215 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118042.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118042.log.gzgzip 2024-09-14T22:46:44.215 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53749.log 2024-09-14T22:46:44.215 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75862.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75862.log.gz 2024-09-14T22:46:44.216 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41506.log 2024-09-14T22:46:44.216 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53749.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53749.log.gz 2024-09-14T22:46:44.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.29545.log 2024-09-14T22:46:44.217 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41506.log.gz 2024-09-14T22:46:44.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145743.log 2024-09-14T22:46:44.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29545.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152072.log 2024-09-14T22:46:44.218 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.29545.log.gz 2024-09-14T22:46:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145743.log.gz 2024-09-14T22:46:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123100.log 2024-09-14T22:46:44.219 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152072.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.152072.log.gz -5 2024-09-14T22:46:44.219 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.134776.log 2024-09-14T22:46:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123100.log.gz 2024-09-14T22:46:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131109.log 2024-09-14T22:46:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134776.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134776.log.gz 2024-09-14T22:46:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106586.log 2024-09-14T22:46:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131109.log.gz 2024-09-14T22:46:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.92995.log 2024-09-14T22:46:44.222 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106586.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106586.log.gz -5 2024-09-14T22:46:44.222 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.121690.log 2024-09-14T22:46:44.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.92995.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.92995.log.gz 2024-09-14T22:46:44.223 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41866.log 2024-09-14T22:46:44.224 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121690.log.gz 2024-09-14T22:46:44.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132439.log 2024-09-14T22:46:44.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41866.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41866.log.gz 2024-09-14T22:46:44.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100191.log 2024-09-14T22:46:44.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132439.log.gz 2024-09-14T22:46:44.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46632.log 2024-09-14T22:46:44.226 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100191.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100191.log.gz 2024-09-14T22:46:44.226 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154143.log 2024-09-14T22:46:44.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46632.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46632.log.gz 2024-09-14T22:46:44.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36937.log 2024-09-14T22:46:44.228 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154143.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154143.log.gz 2024-09-14T22:46:44.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138034.log 2024-09-14T22:46:44.228 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36937.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36937.log.gz 2024-09-14T22:46:44.229 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138409.log 2024-09-14T22:46:44.229 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138034.log.gz 2024-09-14T22:46:44.229 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100612.log 2024-09-14T22:46:44.230 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138409.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138409.log.gz 2024-09-14T22:46:44.230 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104419.log 2024-09-14T22:46:44.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100612.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100612.log.gz 2024-09-14T22:46:44.231 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39706.log 2024-09-14T22:46:44.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104419.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72444.log 2024-09-14T22:46:44.231 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104419.log.gz 2024-09-14T22:46:44.232 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39706.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39706.log.gz 2024-09-14T22:46:44.232 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130846.log 2024-09-14T22:46:44.233 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72444.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72444.log.gz 2024-09-14T22:46:44.233 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97401.log 2024-09-14T22:46:44.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130846.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130846.log.gz 2024-09-14T22:46:44.234 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133423.log 2024-09-14T22:46:44.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97401.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97401.log.gz 2024-09-14T22:46:44.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122302.log 2024-09-14T22:46:44.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133423.log.gz 2024-09-14T22:46:44.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133989.log 2024-09-14T22:46:44.236 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122302.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122302.log.gz 2024-09-14T22:46:44.236 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82322.log 2024-09-14T22:46:44.237 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133989.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.133989.log.gz 2024-09-14T22:46:44.237 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.127679.log 2024-09-14T22:46:44.238 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82322.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82322.log.gz 2024-09-14T22:46:44.238 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39176.log 2024-09-14T22:46:44.238 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127679.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127679.log.gz 2024-09-14T22:46:44.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37161.log 2024-09-14T22:46:44.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39176.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39176.log.gz 2024-09-14T22:46:44.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149189.log 2024-09-14T22:46:44.240 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37161.log.gz 2024-09-14T22:46:44.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75740.log 2024-09-14T22:46:44.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149189.log.gz 2024-09-14T22:46:44.241 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83309.log 2024-09-14T22:46:44.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75740.log.gz 2024-09-14T22:46:44.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65765.log 2024-09-14T22:46:44.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83309.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83309.log.gz 2024-09-14T22:46:44.243 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87306.log 2024-09-14T22:46:44.243 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65765.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99143.log 2024-09-14T22:46:44.243 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65765.log.gz 2024-09-14T22:46:44.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87306.log.gz 2024-09-14T22:46:44.244 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86613.log 2024-09-14T22:46:44.245 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99143.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99143.log.gz 2024-09-14T22:46:44.245 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39429.log 2024-09-14T22:46:44.246 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86613.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86613.log.gz 2024-09-14T22:46:44.246 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39215.log 2024-09-14T22:46:44.247 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39429.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39429.log.gz 2024-09-14T22:46:44.247 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97339.log 2024-09-14T22:46:44.247 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39215.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152429.log 2024-09-14T22:46:44.248 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39215.log.gz 2024-09-14T22:46:44.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97339.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97339.log.gz 2024-09-14T22:46:44.248 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105815.log 2024-09-14T22:46:44.249 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152429.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152429.log.gz 2024-09-14T22:46:44.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148351.log 2024-09-14T22:46:44.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105815.log.gz 2024-09-14T22:46:44.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145459.log 2024-09-14T22:46:44.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148351.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148351.log.gz 2024-09-14T22:46:44.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106224.log 2024-09-14T22:46:44.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145459.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145459.log.gz 2024-09-14T22:46:44.252 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111690.log 2024-09-14T22:46:44.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106224.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106224.log.gz 2024-09-14T22:46:44.252 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126060.log 2024-09-14T22:46:44.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111690.log.gz 2024-09-14T22:46:44.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44255.log 2024-09-14T22:46:44.254 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126060.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126060.log.gz 2024-09-14T22:46:44.254 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38623.log 2024-09-14T22:46:44.254 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44255.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44255.log.gz 2024-09-14T22:46:44.254 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126968.log 2024-09-14T22:46:44.255 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38623.log.gz 2024-09-14T22:46:44.255 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59847.log 2024-09-14T22:46:44.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126968.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145787.log 2024-09-14T22:46:44.256 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126968.log.gz 2024-09-14T22:46:44.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59847.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90766.log 2024-09-14T22:46:44.257 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59847.log.gz 2024-09-14T22:46:44.257 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145787.log.gz 2024-09-14T22:46:44.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.29465.log 2024-09-14T22:46:44.258 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90766.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90766.log.gzgzip 2024-09-14T22:46:44.258 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145576.log 2024-09-14T22:46:44.259 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29465.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109279.log 2024-09-14T22:46:44.259 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.29465.log.gz 2024-09-14T22:46:44.260 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145576.log.gz 2024-09-14T22:46:44.260 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61398.log 2024-09-14T22:46:44.260 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109279.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109279.log.gz 2024-09-14T22:46:44.260 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84598.log 2024-09-14T22:46:44.261 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61398.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113250.log 2024-09-14T22:46:44.261 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61398.log.gz 2024-09-14T22:46:44.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84598.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84598.log.gz 2024-09-14T22:46:44.262 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.34689.log 2024-09-14T22:46:44.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113250.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113250.log.gz 2024-09-14T22:46:44.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35340.log 2024-09-14T22:46:44.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.34689.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133885.log 2024-09-14T22:46:44.264 INFO:teuthology.orchestra.run.smithi169.stderr: 79.5% -- replaced with /var/log/ceph/cluster1-client.mirror.34689.log.gz 2024-09-14T22:46:44.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35340.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35340.log.gz 2024-09-14T22:46:44.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133084.log 2024-09-14T22:46:44.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133885.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133885.log.gz 2024-09-14T22:46:44.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115934.log 2024-09-14T22:46:44.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133084.log.gz 2024-09-14T22:46:44.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152014.log 2024-09-14T22:46:44.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115934.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115934.log.gz 2024-09-14T22:46:44.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35084.log 2024-09-14T22:46:44.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152014.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152014.log.gz 2024-09-14T22:46:44.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47221.log 2024-09-14T22:46:44.268 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35084.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.35084.log.gz -5 2024-09-14T22:46:44.268 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.135912.log 2024-09-14T22:46:44.269 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47221.log.gz 2024-09-14T22:46:44.269 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116658.log 2024-09-14T22:46:44.269 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135912.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.135912.log.gz 2024-09-14T22:46:44.269 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96382.log 2024-09-14T22:46:44.270 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116658.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116658.log.gz 2024-09-14T22:46:44.270 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63937.log 2024-09-14T22:46:44.271 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96382.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96382.log.gzgzip 2024-09-14T22:46:44.271 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.115749.log 2024-09-14T22:46:44.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63937.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63937.log.gz 2024-09-14T22:46:44.272 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109950.log 2024-09-14T22:46:44.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115749.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.admin.115749.log.gz /var/log/ceph/cluster2-client.admin.141309.log 2024-09-14T22:46:44.272 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.273 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109950.log.gz 2024-09-14T22:46:44.273 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123999.log 2024-09-14T22:46:44.274 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141309.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141309.log.gz 2024-09-14T22:46:44.274 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74054.log 2024-09-14T22:46:44.274 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123999.log.gz 2024-09-14T22:46:44.275 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34279.log 2024-09-14T22:46:44.275 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74054.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74054.log.gz 2024-09-14T22:46:44.276 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.152575.log 2024-09-14T22:46:44.276 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34279.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster2-client.admin.34279.log.gz -- 2024-09-14T22:46:44.276 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.142721.log 2024-09-14T22:46:44.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.152575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.152575.log.gz 2024-09-14T22:46:44.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.127852.log 2024-09-14T22:46:44.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142721.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142721.log.gz 2024-09-14T22:46:44.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148892.log 2024-09-14T22:46:44.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.127852.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.127852.log.gz -5 2024-09-14T22:46:44.278 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.132942.log 2024-09-14T22:46:44.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148892.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148892.log.gz 2024-09-14T22:46:44.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62258.log 2024-09-14T22:46:44.280 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132942.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.132942.log.gz 2024-09-14T22:46:44.280 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133338.log 2024-09-14T22:46:44.281 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62258.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62258.log.gz 2024-09-14T22:46:44.281 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48031.log 2024-09-14T22:46:44.281 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133338.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133338.log.gz 2024-09-14T22:46:44.281 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147257.log 2024-09-14T22:46:44.282 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48031.log.gz 2024-09-14T22:46:44.282 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145158.log 2024-09-14T22:46:44.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147257.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123373.log 2024-09-14T22:46:44.283 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147257.log.gz 2024-09-14T22:46:44.284 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145158.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145158.log.gz 2024-09-14T22:46:44.284 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71491.log 2024-09-14T22:46:44.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123373.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123373.log.gz 2024-09-14T22:46:44.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85790.log 2024-09-14T22:46:44.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71491.log.gz 2024-09-14T22:46:44.286 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42760.log 2024-09-14T22:46:44.286 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85790.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85790.log.gz 2024-09-14T22:46:44.286 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53540.log 2024-09-14T22:46:44.287 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42760.log.gz 2024-09-14T22:46:44.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91572.log 2024-09-14T22:46:44.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53540.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.53540.log.gz /var/log/ceph/cluster1-client.admin.92122.log 2024-09-14T22:46:44.288 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91572.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91572.log.gz 2024-09-14T22:46:44.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58314.log 2024-09-14T22:46:44.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92122.log.gz 2024-09-14T22:46:44.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71774.log 2024-09-14T22:46:44.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58314.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58314.log.gz 2024-09-14T22:46:44.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69294.log 2024-09-14T22:46:44.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71774.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.71774.log.gz -5 2024-09-14T22:46:44.291 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.136080.log 2024-09-14T22:46:44.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69294.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69294.log.gz 2024-09-14T22:46:44.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97170.log 2024-09-14T22:46:44.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136080.log.gz 2024-09-14T22:46:44.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93352.log 2024-09-14T22:46:44.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97170.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97170.log.gz 2024-09-14T22:46:44.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133295.log 2024-09-14T22:46:44.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93352.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93352.log.gz 2024-09-14T22:46:44.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53665.log 2024-09-14T22:46:44.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133295.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133295.log.gz 2024-09-14T22:46:44.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142900.log 2024-09-14T22:46:44.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53665.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53665.log.gz 2024-09-14T22:46:44.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111965.log 2024-09-14T22:46:44.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142900.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142900.log.gz 2024-09-14T22:46:44.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148563.log 2024-09-14T22:46:44.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111965.log.gz 2024-09-14T22:46:44.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49007.log 2024-09-14T22:46:44.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148563.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148563.log.gz 2024-09-14T22:46:44.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94804.log 2024-09-14T22:46:44.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49007.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49007.log.gz 2024-09-14T22:46:44.299 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101623.log 2024-09-14T22:46:44.299 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94804.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94804.log.gz 2024-09-14T22:46:44.299 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41738.log 2024-09-14T22:46:44.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101623.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140488.log 2024-09-14T22:46:44.300 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101623.log.gz 2024-09-14T22:46:44.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41738.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76159.log 2024-09-14T22:46:44.301 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41738.log.gz 2024-09-14T22:46:44.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140488.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140488.log.gz 2024-09-14T22:46:44.302 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150765.log 2024-09-14T22:46:44.302 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76159.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76159.log.gz 2024-09-14T22:46:44.302 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72233.log 2024-09-14T22:46:44.303 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150765.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150765.log.gz 2024-09-14T22:46:44.303 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74903.log 2024-09-14T22:46:44.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72233.log.gz 2024-09-14T22:46:44.304 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49507.log 2024-09-14T22:46:44.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74903.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106043.log 2024-09-14T22:46:44.305 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74903.log.gz 2024-09-14T22:46:44.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49507.log.gz 2024-09-14T22:46:44.305 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56088.log 2024-09-14T22:46:44.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106043.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106043.log.gz 2024-09-14T22:46:44.306 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90395.log 2024-09-14T22:46:44.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56088.log.gz 2024-09-14T22:46:44.307 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.29505.log 2024-09-14T22:46:44.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90395.log.gz 2024-09-14T22:46:44.307 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75104.log 2024-09-14T22:46:44.308 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29505.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster2-client.admin.29505.log.gz -- 2024-09-14T22:46:44.308 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.35016.log 2024-09-14T22:46:44.309 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75104.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75104.log.gz 2024-09-14T22:46:44.309 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65197.log 2024-09-14T22:46:44.310 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35016.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35016.log.gz 2024-09-14T22:46:44.310 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94737.log 2024-09-14T22:46:44.310 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65197.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65197.log.gz 2024-09-14T22:46:44.310 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109803.log 2024-09-14T22:46:44.311 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94737.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94737.log.gz 2024-09-14T22:46:44.311 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97026.log 2024-09-14T22:46:44.312 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109803.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109803.log.gz -5 2024-09-14T22:46:44.312 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.151125.log 2024-09-14T22:46:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97026.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97026.log.gz 2024-09-14T22:46:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64085.log 2024-09-14T22:46:44.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151125.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151125.log.gz 2024-09-14T22:46:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136458.log 2024-09-14T22:46:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64085.log.gz 2024-09-14T22:46:44.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109614.log 2024-09-14T22:46:44.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136458.log.gz 2024-09-14T22:46:44.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75233.log 2024-09-14T22:46:44.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109614.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109614.log.gz 2024-09-14T22:46:44.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82068.log 2024-09-14T22:46:44.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75233.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75233.log.gz -5 2024-09-14T22:46:44.316 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.136162.log 2024-09-14T22:46:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82068.log.gz 2024-09-14T22:46:44.317 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72754.log 2024-09-14T22:46:44.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136162.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.136162.log.gz --verbose 2024-09-14T22:46:44.318 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.mirror.152286.log 2024-09-14T22:46:44.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72754.log.gz 2024-09-14T22:46:44.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119380.log 2024-09-14T22:46:44.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152286.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152286.log.gz 2024-09-14T22:46:44.320 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114874.log 2024-09-14T22:46:44.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119380.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119380.log.gz 2024-09-14T22:46:44.320 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120427.log 2024-09-14T22:46:44.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114874.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76073.log 0.0% 2024-09-14T22:46:44.321 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.114874.log.gz 2024-09-14T22:46:44.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120427.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120427.log.gz 2024-09-14T22:46:44.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58697.log 2024-09-14T22:46:44.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76073.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76073.log.gz 2024-09-14T22:46:44.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70642.log 2024-09-14T22:46:44.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58697.log.gz 2024-09-14T22:46:44.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123162.log 2024-09-14T22:46:44.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70642.log.gz 2024-09-14T22:46:44.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86824.log 2024-09-14T22:46:44.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123162.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123162.log.gz 2024-09-14T22:46:44.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87522.log 2024-09-14T22:46:44.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86824.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.86824.log.gz 2024-09-14T22:46:44.326 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42223.log 2024-09-14T22:46:44.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87522.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87522.log.gz 2024-09-14T22:46:44.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123099.log 2024-09-14T22:46:44.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42223.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42223.log.gz 2024-09-14T22:46:44.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102123.log 2024-09-14T22:46:44.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123099.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123099.log.gz 2024-09-14T22:46:44.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86527.log 2024-09-14T22:46:44.329 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102123.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.120251.log 2024-09-14T22:46:44.329 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102123.log.gz 2024-09-14T22:46:44.330 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86527.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86527.log.gz -5 2024-09-14T22:46:44.330 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.58610.log 2024-09-14T22:46:44.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.120251.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.120251.log.gz 2024-09-14T22:46:44.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92620.log 2024-09-14T22:46:44.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58610.log.gz 2024-09-14T22:46:44.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146313.log 2024-09-14T22:46:44.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92620.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92620.log.gz 2024-09-14T22:46:44.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49735.log 2024-09-14T22:46:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146313.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146313.log.gz 2024-09-14T22:46:44.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80416.log 2024-09-14T22:46:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49735.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49735.log.gzgzip 2024-09-14T22:46:44.334 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51357.log 2024-09-14T22:46:44.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80416.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80416.log.gz 2024-09-14T22:46:44.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73927.log 2024-09-14T22:46:44.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51357.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51357.log.gz 2024-09-14T22:46:44.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70092.log 2024-09-14T22:46:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73927.log.gz 2024-09-14T22:46:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135072.log 2024-09-14T22:46:44.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70092.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70092.log.gz 2024-09-14T22:46:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87726.log 2024-09-14T22:46:44.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135072.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135072.log.gz 2024-09-14T22:46:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81047.log 2024-09-14T22:46:44.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87726.log.gzgzip 2024-09-14T22:46:44.338 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146042.log 2024-09-14T22:46:44.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81047.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81047.log.gz 2024-09-14T22:46:44.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121375.log 2024-09-14T22:46:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146042.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146042.log.gz 2024-09-14T22:46:44.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82208.log 2024-09-14T22:46:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121375.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98324.log 2024-09-14T22:46:44.341 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121375.log.gz 2024-09-14T22:46:44.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82208.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84850.log 2024-09-14T22:46:44.341 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82208.log.gz 2024-09-14T22:46:44.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98324.log.gz 2024-09-14T22:46:44.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56958.log 2024-09-14T22:46:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84850.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84850.log.gz 2024-09-14T22:46:44.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123689.log 2024-09-14T22:46:44.344 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56958.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56958.log.gz 2024-09-14T22:46:44.344 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41047.log 2024-09-14T22:46:44.345 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123689.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68677.log 2024-09-14T22:46:44.345 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123689.log.gz 2024-09-14T22:46:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41047.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81162.log 2024-09-14T22:46:44.346 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41047.log.gz 2024-09-14T22:46:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68677.log.gz 2024-09-14T22:46:44.346 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44614.log 2024-09-14T22:46:44.347 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81162.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81162.log.gz 2024-09-14T22:46:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60938.log 2024-09-14T22:46:44.348 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117149.log 2024-09-14T22:46:44.348 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44614.log.gz 2024-09-14T22:46:44.349 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60938.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60938.log.gz 2024-09-14T22:46:44.349 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141728.log 2024-09-14T22:46:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117149.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117149.log.gz 2024-09-14T22:46:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51523.log 2024-09-14T22:46:44.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141728.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141728.log.gz 2024-09-14T22:46:44.351 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61921.log 2024-09-14T22:46:44.351 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51523.log.gz 2024-09-14T22:46:44.351 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118243.log 2024-09-14T22:46:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61921.log.gz 2024-09-14T22:46:44.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121500.log 2024-09-14T22:46:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118243.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118243.log.gz 2024-09-14T22:46:44.353 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100677.log 2024-09-14T22:46:44.354 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121500.log.gz 2024-09-14T22:46:44.354 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72300.log 2024-09-14T22:46:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100677.log.gz 2024-09-14T22:46:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73322.log 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72300.log.gz 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36132.log 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73322.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73322.log.gz 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103463.log 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36132.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36132.log.gz 2024-09-14T22:46:44.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107912.log 2024-09-14T22:46:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103463.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77120.log 2024-09-14T22:46:44.358 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103463.log.gz 2024-09-14T22:46:44.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107912.log.gz 2024-09-14T22:46:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104204.log 2024-09-14T22:46:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77120.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77120.log.gz 2024-09-14T22:46:44.359 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40479.log 2024-09-14T22:46:44.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104204.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104204.log.gz 2024-09-14T22:46:44.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121079.log 2024-09-14T22:46:44.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40479.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40479.log.gz 2024-09-14T22:46:44.361 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106317.log 2024-09-14T22:46:44.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121079.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121079.log.gz 2024-09-14T22:46:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48401.log 2024-09-14T22:46:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106317.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106317.log.gz 2024-09-14T22:46:44.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99837.log 2024-09-14T22:46:44.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48401.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.48401.log.gz -- 2024-09-14T22:46:44.363 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.73571.log 2024-09-14T22:46:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99837.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99837.log.gz 2024-09-14T22:46:44.364 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59964.log 2024-09-14T22:46:44.365 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73571.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73571.log.gz 2024-09-14T22:46:44.365 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44088.log 2024-09-14T22:46:44.365 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59964.log.gz 2024-09-14T22:46:44.365 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49675.log 2024-09-14T22:46:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44088.log.gz 2024-09-14T22:46:44.366 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71290.log 2024-09-14T22:46:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49675.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49675.log.gz 2024-09-14T22:46:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118471.log 2024-09-14T22:46:44.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71290.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71290.log.gzgzip 2024-09-14T22:46:44.368 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36178.log 2024-09-14T22:46:44.368 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118471.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37114.log 2024-09-14T22:46:44.368 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118471.log.gz 2024-09-14T22:46:44.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36178.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90981.log 2024-09-14T22:46:44.369 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36178.log.gz 2024-09-14T22:46:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37114.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37114.log.gz 2024-09-14T22:46:44.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43837.log 2024-09-14T22:46:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90981.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90981.log.gz 2024-09-14T22:46:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59169.log 2024-09-14T22:46:44.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43837.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.60000.log 2024-09-14T22:46:44.371 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.43837.log.gz 2024-09-14T22:46:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59169.log.gz 2024-09-14T22:46:44.372 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74748.log 2024-09-14T22:46:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60000.log.gz 2024-09-14T22:46:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-mgr.x.log 2024-09-14T22:46:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74748.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.74748.log.gz 2024-09-14T22:46:44.374 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.93317.log 2024-09-14T22:46:44.374 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71623.log 2024-09-14T22:46:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93317.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93317.log.gz 2024-09-14T22:46:44.375 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149463.log 2024-09-14T22:46:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71623.log.gz 2024-09-14T22:46:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42159.log 2024-09-14T22:46:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149463.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149463.log.gz 2024-09-14T22:46:44.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55126.log 2024-09-14T22:46:44.377 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42159.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42159.log.gz 2024-09-14T22:46:44.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74898.log 2024-09-14T22:46:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55126.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55126.log.gz 2024-09-14T22:46:44.378 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57628.log 2024-09-14T22:46:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74898.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74898.log.gzgzip 2024-09-14T22:46:44.379 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.43991.log 2024-09-14T22:46:44.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57628.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116927.log 2024-09-14T22:46:44.380 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57628.log.gz 2024-09-14T22:46:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43991.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43991.log.gz 2024-09-14T22:46:44.380 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122447.log 2024-09-14T22:46:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116927.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.116927.log.gz 2024-09-14T22:46:44.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80835.log 2024-09-14T22:46:44.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122447.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122447.log.gz 2024-09-14T22:46:44.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84246.log 2024-09-14T22:46:44.383 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80835.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80835.log.gz 2024-09-14T22:46:44.383 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37371.log 2024-09-14T22:46:44.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84246.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101915.log 2024-09-14T22:46:44.384 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84246.log.gz 2024-09-14T22:46:44.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37371.log.gz 2024-09-14T22:46:44.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127591.log 2024-09-14T22:46:44.385 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101915.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141124.log 2024-09-14T22:46:44.385 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101915.log.gz 2024-09-14T22:46:44.386 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127591.log.gz 2024-09-14T22:46:44.386 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36549.log 2024-09-14T22:46:44.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141124.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141124.log.gzgzip 2024-09-14T22:46:44.387 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102212.log 2024-09-14T22:46:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36549.log.gz 2024-09-14T22:46:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140038.log 2024-09-14T22:46:44.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102212.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102212.log.gz 2024-09-14T22:46:44.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73114.log 2024-09-14T22:46:44.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140038.log.gz 2024-09-14T22:46:44.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149823.log 2024-09-14T22:46:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73114.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73114.log.gz 2024-09-14T22:46:44.390 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94877.log 2024-09-14T22:46:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149823.log.gz 2024-09-14T22:46:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126324.log 2024-09-14T22:46:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94877.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94877.log.gz 2024-09-14T22:46:44.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75483.log 2024-09-14T22:46:44.392 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126324.log.gz 2024-09-14T22:46:44.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66163.log 2024-09-14T22:46:44.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75483.log.gz 2024-09-14T22:46:44.393 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69545.log 2024-09-14T22:46:44.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66163.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66163.log.gz 2024-09-14T22:46:44.394 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99145.log 2024-09-14T22:46:44.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69545.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69545.log.gz 2024-09-14T22:46:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83502.log 2024-09-14T22:46:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99145.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99145.log.gz 2024-09-14T22:46:44.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111135.log 2024-09-14T22:46:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83502.log.gz 2024-09-14T22:46:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40964.log 2024-09-14T22:46:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111135.log.gz 2024-09-14T22:46:44.397 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107231.log 2024-09-14T22:46:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40964.log.gz 2024-09-14T22:46:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68290.log 2024-09-14T22:46:44.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107231.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107231.log.gz 2024-09-14T22:46:44.399 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99563.log 2024-09-14T22:46:44.399 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68290.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154343.log 2024-09-14T22:46:44.399 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68290.log.gz 2024-09-14T22:46:44.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99563.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99563.log.gz 2024-09-14T22:46:44.400 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73888.log 2024-09-14T22:46:44.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154343.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154343.log.gz 2024-09-14T22:46:44.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74120.log 2024-09-14T22:46:44.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73888.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73888.log.gz 2024-09-14T22:46:44.402 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67743.log 2024-09-14T22:46:44.402 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74120.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.74120.log.gz -- 2024-09-14T22:46:44.402 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.133507.log 2024-09-14T22:46:44.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67743.log.gz 2024-09-14T22:46:44.403 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101961.log 2024-09-14T22:46:44.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133507.log.gz 2024-09-14T22:46:44.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96964.log 2024-09-14T22:46:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101961.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101961.log.gz 2024-09-14T22:46:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144512.log 2024-09-14T22:46:44.405 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96964.log.gz 2024-09-14T22:46:44.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108966.log 2024-09-14T22:46:44.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144512.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144512.log.gz 2024-09-14T22:46:44.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80947.log 2024-09-14T22:46:44.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108966.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108966.log.gz 2024-09-14T22:46:44.407 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143548.log 2024-09-14T22:46:44.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80947.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80947.log.gz 2024-09-14T22:46:44.408 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137800.log 2024-09-14T22:46:44.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143548.log.gz 2024-09-14T22:46:44.409 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144233.log 2024-09-14T22:46:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137800.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137800.log.gz 2024-09-14T22:46:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151124.log 2024-09-14T22:46:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144233.log.gz 2024-09-14T22:46:44.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81549.log 2024-09-14T22:46:44.411 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151124.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151124.log.gz 2024-09-14T22:46:44.411 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154116.log 2024-09-14T22:46:44.412 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81549.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81549.log.gz 2024-09-14T22:46:44.412 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.141480.log 2024-09-14T22:46:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154116.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154116.log.gz 2024-09-14T22:46:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121912.log 2024-09-14T22:46:44.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.141480.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.141480.log.gz 2024-09-14T22:46:44.414 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112301.log 2024-09-14T22:46:44.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121912.log.gz 2024-09-14T22:46:44.414 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127120.log 2024-09-14T22:46:44.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112301.log.gz 2024-09-14T22:46:44.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51859.log 2024-09-14T22:46:44.416 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127120.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127120.log.gz 2024-09-14T22:46:44.416 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70943.log 2024-09-14T22:46:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51859.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51859.log.gz 2024-09-14T22:46:44.417 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70072.log 2024-09-14T22:46:44.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70943.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40478.log 2024-09-14T22:46:44.418 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70943.log.gz 2024-09-14T22:46:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70072.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71693.log 2024-09-14T22:46:44.419 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70072.log.gz 2024-09-14T22:46:44.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40478.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40478.log.gz 2024-09-14T22:46:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86130.log 2024-09-14T22:46:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71693.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71693.log.gz 2024-09-14T22:46:44.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133506.log 2024-09-14T22:46:44.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86130.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86130.log.gz 2024-09-14T22:46:44.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98873.log 2024-09-14T22:46:44.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133506.log.gz 2024-09-14T22:46:44.422 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111485.log 2024-09-14T22:46:44.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98873.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98873.log.gz 2024-09-14T22:46:44.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107539.log 2024-09-14T22:46:44.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111485.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111485.log.gz 2024-09-14T22:46:44.424 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126604.log 2024-09-14T22:46:44.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107539.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107539.log.gz 2024-09-14T22:46:44.424 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59809.log 2024-09-14T22:46:44.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126604.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126604.log.gz 2024-09-14T22:46:44.425 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113588.log 2024-09-14T22:46:44.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59809.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59809.log.gz 2024-09-14T22:46:44.426 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98515.log 2024-09-14T22:46:44.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113588.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113588.log.gz 2024-09-14T22:46:44.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147131.log 2024-09-14T22:46:44.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98515.log.gz 2024-09-14T22:46:44.428 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61732.log 2024-09-14T22:46:44.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147131.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147131.log.gz 2024-09-14T22:46:44.428 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91946.log 2024-09-14T22:46:44.429 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61732.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61732.log.gz 2024-09-14T22:46:44.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91903.log 2024-09-14T22:46:44.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91946.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91946.log.gz 2024-09-14T22:46:44.430 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40604.log 2024-09-14T22:46:44.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91903.log.gz 2024-09-14T22:46:44.431 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133927.log 2024-09-14T22:46:44.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40604.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57664.log 2024-09-14T22:46:44.432 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40604.log.gz 2024-09-14T22:46:44.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133927.log.gz 2024-09-14T22:46:44.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66091.log 2024-09-14T22:46:44.433 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57664.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57664.log.gz 2024-09-14T22:46:44.433 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129118.log 2024-09-14T22:46:44.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66091.log.gz 2024-09-14T22:46:44.434 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152209.log 2024-09-14T22:46:44.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129118.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129118.log.gz 2024-09-14T22:46:44.435 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88319.log 2024-09-14T22:46:44.436 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152209.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152209.log.gz 2024-09-14T22:46:44.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44454.log 2024-09-14T22:46:44.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88319.log.gz 2024-09-14T22:46:44.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102827.log 2024-09-14T22:46:44.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44454.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44454.log.gz 2024-09-14T22:46:44.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57210.log 2024-09-14T22:46:44.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102827.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102827.log.gz 2024-09-14T22:46:44.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133023.log 2024-09-14T22:46:44.439 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57210.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57210.log.gz 2024-09-14T22:46:44.439 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37727.log 2024-09-14T22:46:44.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133023.log.gz 2024-09-14T22:46:44.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152372.log 2024-09-14T22:46:44.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37727.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37727.log.gz 2024-09-14T22:46:44.441 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65409.log 2024-09-14T22:46:44.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152372.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152372.log.gzgzip 2024-09-14T22:46:44.442 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88987.log 2024-09-14T22:46:44.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65409.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65409.log.gz 2024-09-14T22:46:44.442 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147826.log 2024-09-14T22:46:44.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88987.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88987.log.gz 2024-09-14T22:46:44.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147487.log 2024-09-14T22:46:44.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147826.log.gz 2024-09-14T22:46:44.444 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105452.log 2024-09-14T22:46:44.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147487.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61209.log 2024-09-14T22:46:44.445 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147487.log.gz 2024-09-14T22:46:44.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105452.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105452.log.gz 2024-09-14T22:46:44.445 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61270.log 2024-09-14T22:46:44.446 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61209.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61209.log.gz 2024-09-14T22:46:44.446 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117456.log 2024-09-14T22:46:44.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61270.log.gz 2024-09-14T22:46:44.447 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147402.log 2024-09-14T22:46:44.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117456.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117456.log.gz 2024-09-14T22:46:44.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149403.log 2024-09-14T22:46:44.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147402.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147402.log.gz 2024-09-14T22:46:44.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144085.log 2024-09-14T22:46:44.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149403.log.gz 2024-09-14T22:46:44.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100318.log 2024-09-14T22:46:44.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144085.log.gz 2024-09-14T22:46:44.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89447.log 2024-09-14T22:46:44.451 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100318.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100318.log.gz 2024-09-14T22:46:44.451 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134653.log 2024-09-14T22:46:44.452 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89447.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89447.log.gz 2024-09-14T22:46:44.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142465.log 2024-09-14T22:46:44.453 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134653.log.gz 2024-09-14T22:46:44.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92231.log 2024-09-14T22:46:44.454 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142465.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142465.log.gz 2024-09-14T22:46:44.454 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59563.log 2024-09-14T22:46:44.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92231.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92231.log.gz 2024-09-14T22:46:44.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69495.log 2024-09-14T22:46:44.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59563.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59563.log.gz 2024-09-14T22:46:44.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77369.log 2024-09-14T22:46:44.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69495.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69495.log.gz 2024-09-14T22:46:44.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111064.log 2024-09-14T22:46:44.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77369.log.gz 2024-09-14T22:46:44.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99210.log 2024-09-14T22:46:44.458 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111064.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111064.log.gz 2024-09-14T22:46:44.458 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65565.log 2024-09-14T22:46:44.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99210.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81796.log 2024-09-14T22:46:44.459 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99210.log.gz 2024-09-14T22:46:44.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65565.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65565.log.gz 2024-09-14T22:46:44.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.54891.log 2024-09-14T22:46:44.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81796.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81796.log.gz 2024-09-14T22:46:44.461 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68717.log 2024-09-14T22:46:44.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.54891.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.54891.log.gz 2024-09-14T22:46:44.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76581.log 2024-09-14T22:46:44.462 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68717.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68717.log.gz 2024-09-14T22:46:44.463 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50937.log 2024-09-14T22:46:44.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76581.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76581.log.gz 2024-09-14T22:46:44.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37052.log 2024-09-14T22:46:44.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50937.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50937.log.gz 2024-09-14T22:46:44.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52785.log 2024-09-14T22:46:44.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37052.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37052.log.gz 2024-09-14T22:46:44.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153204.log 2024-09-14T22:46:44.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52785.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52785.log.gz 2024-09-14T22:46:44.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48338.log 2024-09-14T22:46:44.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153204.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153204.log.gz 2024-09-14T22:46:44.467 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132983.log 2024-09-14T22:46:44.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48338.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47416.log 2024-09-14T22:46:44.468 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48338.log.gz 2024-09-14T22:46:44.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132983.log.gz 2024-09-14T22:46:44.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.108039.log 2024-09-14T22:46:44.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47416.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47416.log.gz 2024-09-14T22:46:44.469 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77920.log 2024-09-14T22:46:44.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.108039.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.108039.log.gz 2024-09-14T22:46:44.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122679.log 2024-09-14T22:46:44.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77920.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77920.log.gz 2024-09-14T22:46:44.471 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65912.log 2024-09-14T22:46:44.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122679.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122679.log.gz 2024-09-14T22:46:44.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53960.log 2024-09-14T22:46:44.473 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65912.log.gz 2024-09-14T22:46:44.473 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125369.log 2024-09-14T22:46:44.473 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53960.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53960.log.gz 2024-09-14T22:46:44.473 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108482.log 2024-09-14T22:46:44.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125369.log.gz 2024-09-14T22:46:44.474 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112747.log 2024-09-14T22:46:44.475 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108482.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108482.log.gz 2024-09-14T22:46:44.475 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75610.log 2024-09-14T22:46:44.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112747.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112747.log.gz 2024-09-14T22:46:44.476 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.105996.log 2024-09-14T22:46:44.477 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75610.log.gz 2024-09-14T22:46:44.477 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122847.log 2024-09-14T22:46:44.477 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.105996.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.105996.log.gz 2024-09-14T22:46:44.477 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153733.log 2024-09-14T22:46:44.478 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122847.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122847.log.gz 2024-09-14T22:46:44.478 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142325.log 2024-09-14T22:46:44.479 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153733.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153733.log.gz 2024-09-14T22:46:44.479 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143753.log 2024-09-14T22:46:44.479 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142325.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142325.log.gz 2024-09-14T22:46:44.480 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61698.log 2024-09-14T22:46:44.480 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143753.log.gz 2024-09-14T22:46:44.481 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100734.log 2024-09-14T22:46:44.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61698.log.gz 2024-09-14T22:46:44.482 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153485.log 2024-09-14T22:46:44.482 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100734.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100734.log.gz 2024-09-14T22:46:44.483 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63269.log 2024-09-14T22:46:44.483 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153485.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153485.log.gz 2024-09-14T22:46:44.483 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78298.log 2024-09-14T22:46:44.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63269.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63269.log.gz 2024-09-14T22:46:44.484 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55758.log 2024-09-14T22:46:44.485 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78298.log.gz 2024-09-14T22:46:44.485 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89576.log 2024-09-14T22:46:44.486 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55758.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55758.log.gz 2024-09-14T22:46:44.486 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152737.log 2024-09-14T22:46:44.486 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89576.log.gz 2024-09-14T22:46:44.486 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.143843.log 2024-09-14T22:46:44.487 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152737.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152737.log.gzgzip 2024-09-14T22:46:44.487 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86731.log 2024-09-14T22:46:44.488 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.143843.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.143843.log.gz 2024-09-14T22:46:44.488 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86441.log 2024-09-14T22:46:44.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86731.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86731.log.gz 2024-09-14T22:46:44.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43057.log 2024-09-14T22:46:44.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86441.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86441.log.gz 2024-09-14T22:46:44.490 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53877.log 2024-09-14T22:46:44.490 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43057.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.89068.log -- replaced with /var/log/ceph/cluster1-client.mirror.43057.log.gz 2024-09-14T22:46:44.490 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.491 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53877.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53877.log.gz 2024-09-14T22:46:44.491 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51442.log 2024-09-14T22:46:44.492 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89068.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.147024.log 2024-09-14T22:46:44.492 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.89068.log.gz 2024-09-14T22:46:44.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51442.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51442.log.gz 2024-09-14T22:46:44.493 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122171.log 2024-09-14T22:46:44.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147024.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147024.log.gz 2024-09-14T22:46:44.494 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50390.log 2024-09-14T22:46:44.494 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122171.log.gz 2024-09-14T22:46:44.494 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77457.log 2024-09-14T22:46:44.495 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50390.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50390.log.gz 2024-09-14T22:46:44.495 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47258.log 2024-09-14T22:46:44.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77457.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104602.log 2024-09-14T22:46:44.496 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77457.log.gz 2024-09-14T22:46:44.497 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47258.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47258.log.gz 2024-09-14T22:46:44.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134388.log 2024-09-14T22:46:44.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150280.log 2024-09-14T22:46:44.498 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104602.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104602.log.gz 2024-09-14T22:46:44.498 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134388.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134388.log.gz 2024-09-14T22:46:44.498 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137299.log 2024-09-14T22:46:44.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150280.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150280.log.gz 2024-09-14T22:46:44.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143950.log 2024-09-14T22:46:44.500 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137299.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137299.log.gz 2024-09-14T22:46:44.500 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133653.log 2024-09-14T22:46:44.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143950.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143950.log.gz 2024-09-14T22:46:44.501 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146710.log 2024-09-14T22:46:44.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133653.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133653.log.gz 2024-09-14T22:46:44.502 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114091.log 2024-09-14T22:46:44.502 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146710.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146710.log.gz 2024-09-14T22:46:44.502 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87098.log 2024-09-14T22:46:44.503 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114091.log.gz 2024-09-14T22:46:44.503 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153126.log 2024-09-14T22:46:44.504 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87098.log.gz 2024-09-14T22:46:44.504 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98868.log 2024-09-14T22:46:44.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153126.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153126.log.gz 2024-09-14T22:46:44.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98851.log 2024-09-14T22:46:44.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98868.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98868.log.gz 2024-09-14T22:46:44.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.59112.log 2024-09-14T22:46:44.506 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98851.log.gz 2024-09-14T22:46:44.506 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52951.log 2024-09-14T22:46:44.507 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.59112.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.59112.log.gz 2024-09-14T22:46:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47525.log 2024-09-14T22:46:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52951.log.gz 2024-09-14T22:46:44.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72691.log 2024-09-14T22:46:44.509 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47525.log.gz 2024-09-14T22:46:44.509 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69927.log 2024-09-14T22:46:44.510 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72691.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.119834.log -- replaced with /var/log/ceph/cluster1-client.mirror.72691.log.gz 2024-09-14T22:46:44.510 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69927.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69927.log.gz 2024-09-14T22:46:44.511 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56820.log 2024-09-14T22:46:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119834.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119834.log.gz 2024-09-14T22:46:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144300.log 2024-09-14T22:46:44.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56820.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65135.log 2024-09-14T22:46:44.513 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56820.log.gz 2024-09-14T22:46:44.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144300.log.gz 2024-09-14T22:46:44.513 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53917.log 2024-09-14T22:46:44.514 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65135.log.gz 2024-09-14T22:46:44.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149733.log 2024-09-14T22:46:44.515 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53917.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53917.log.gz 2024-09-14T22:46:44.515 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66924.log 2024-09-14T22:46:44.515 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149733.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149733.log.gz 2024-09-14T22:46:44.516 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119551.log 2024-09-14T22:46:44.516 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66924.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66924.log.gz 2024-09-14T22:46:44.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39639.log 2024-09-14T22:46:44.518 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119551.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119551.log.gz 2024-09-14T22:46:44.518 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121227.log 2024-09-14T22:46:44.518 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39639.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39639.log.gz 2024-09-14T22:46:44.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135494.log 2024-09-14T22:46:44.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121227.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121227.log.gz 2024-09-14T22:46:44.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.46017.log 2024-09-14T22:46:44.520 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135494.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73760.log 2024-09-14T22:46:44.520 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135494.log.gz 2024-09-14T22:46:44.521 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.46017.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141065.log 2024-09-14T22:46:44.521 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.46017.log.gz 2024-09-14T22:46:44.522 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73760.log.gz 2024-09-14T22:46:44.522 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150190.log 2024-09-14T22:46:44.522 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141065.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141065.log.gz 2024-09-14T22:46:44.523 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46195.log 2024-09-14T22:46:44.524 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150190.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150190.log.gz 2024-09-14T22:46:44.524 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.55157.log 2024-09-14T22:46:44.525 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46195.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46195.log.gz 2024-09-14T22:46:44.525 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36216.log 2024-09-14T22:46:44.525 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.55157.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.55157.log.gz 2024-09-14T22:46:44.525 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88861.log 2024-09-14T22:46:44.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36216.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112533.log 2024-09-14T22:46:44.526 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36216.log.gz 2024-09-14T22:46:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88861.log.gz 2024-09-14T22:46:44.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69006.log 2024-09-14T22:46:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112533.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112533.log.gz 2024-09-14T22:46:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80973.log 2024-09-14T22:46:44.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69006.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69006.log.gz 2024-09-14T22:46:44.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43860.log 2024-09-14T22:46:44.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80973.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80973.log.gz 2024-09-14T22:46:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52617.log 2024-09-14T22:46:44.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43860.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43860.log.gz 2024-09-14T22:46:44.531 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111023.log 2024-09-14T22:46:44.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52617.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52617.log.gz 2024-09-14T22:46:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96881.log 2024-09-14T22:46:44.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111023.log.gz 2024-09-14T22:46:44.533 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38505.log 2024-09-14T22:46:44.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96881.log.gz 2024-09-14T22:46:44.533 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110602.log 2024-09-14T22:46:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38505.log.gz 2024-09-14T22:46:44.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59261.log 2024-09-14T22:46:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110602.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110602.log.gz 2024-09-14T22:46:44.535 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60726.log 2024-09-14T22:46:44.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59261.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59261.log.gz 2024-09-14T22:46:44.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89408.log 2024-09-14T22:46:44.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60726.log.gz 2024-09-14T22:46:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53245.log 2024-09-14T22:46:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89408.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89408.log.gz 2024-09-14T22:46:44.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37367.log 2024-09-14T22:46:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53245.log.gz 2024-09-14T22:46:44.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143580.log 2024-09-14T22:46:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37367.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37367.log.gz 2024-09-14T22:46:44.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148263.log 2024-09-14T22:46:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143580.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143580.log.gz 2024-09-14T22:46:44.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58408.log 2024-09-14T22:46:44.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148263.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148263.log.gz 2024-09-14T22:46:44.541 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144804.log 2024-09-14T22:46:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58408.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58408.log.gz 2024-09-14T22:46:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66908.log 2024-09-14T22:46:44.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144804.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.144804.log.gz /var/log/ceph/cluster1-client.admin.92621.log 2024-09-14T22:46:44.542 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66908.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132022.log 2024-09-14T22:46:44.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66908.log.gz 2024-09-14T22:46:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92621.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92621.log.gz 2024-09-14T22:46:44.544 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114725.log 2024-09-14T22:46:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132022.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132022.log.gz 2024-09-14T22:46:44.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58355.log 2024-09-14T22:46:44.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114725.log.gz 2024-09-14T22:46:44.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153412.log 2024-09-14T22:46:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58355.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58355.log.gz 2024-09-14T22:46:44.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77396.log 2024-09-14T22:46:44.548 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153412.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153412.log.gz 2024-09-14T22:46:44.548 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112492.log 2024-09-14T22:46:44.549 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77396.log.gz 2024-09-14T22:46:44.549 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89067.log 2024-09-14T22:46:44.549 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112492.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112492.log.gz 2024-09-14T22:46:44.549 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42775.log 2024-09-14T22:46:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89067.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89067.log.gz 2024-09-14T22:46:44.550 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78627.log 2024-09-14T22:46:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42775.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42775.log.gz 2024-09-14T22:46:44.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146458.log 2024-09-14T22:46:44.552 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78627.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78627.log.gz 2024-09-14T22:46:44.552 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80362.log 2024-09-14T22:46:44.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146458.log.gz 2024-09-14T22:46:44.553 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42658.log 2024-09-14T22:46:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80362.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80362.log.gz 2024-09-14T22:46:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.60395.log 2024-09-14T22:46:44.554 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42658.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42658.log.gz 2024-09-14T22:46:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98810.log 2024-09-14T22:46:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.60395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.60395.log.gz 2024-09-14T22:46:44.555 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72650.log 2024-09-14T22:46:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98810.log.gz 2024-09-14T22:46:44.556 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126957.log 2024-09-14T22:46:44.557 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72650.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111126.log 0.0% 2024-09-14T22:46:44.557 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.72650.log.gz 2024-09-14T22:46:44.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126957.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126957.log.gz 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142831.log 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111126.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111126.log.gz 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130710.log 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142831.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142831.log.gz 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70735.log 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130710.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130710.log.gz 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37830.log 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70735.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70735.log.gz 2024-09-14T22:46:44.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131178.log 2024-09-14T22:46:44.563 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37830.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85622.log 2024-09-14T22:46:44.563 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37830.log.gz 2024-09-14T22:46:44.563 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131178.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131178.log.gz 2024-09-14T22:46:44.563 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65491.log 2024-09-14T22:46:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85622.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85622.log.gz 2024-09-14T22:46:44.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152428.log 2024-09-14T22:46:44.565 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65491.log.gz 2024-09-14T22:46:44.565 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70259.log 2024-09-14T22:46:44.565 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152428.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152428.log.gz 2024-09-14T22:46:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88439.log 2024-09-14T22:46:44.566 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70259.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70259.log.gz 2024-09-14T22:46:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44331.log 2024-09-14T22:46:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88439.log.gz 2024-09-14T22:46:44.567 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101031.log 2024-09-14T22:46:44.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44331.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101118.log 2024-09-14T22:46:44.568 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44331.log.gz 2024-09-14T22:46:44.569 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101031.log.gz 2024-09-14T22:46:44.569 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130587.log 2024-09-14T22:46:44.570 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101118.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112134.log 2024-09-14T22:46:44.570 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101118.log.gz 2024-09-14T22:46:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130587.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130587.log.gz 2024-09-14T22:46:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87350.log 2024-09-14T22:46:44.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112134.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112134.log.gz 2024-09-14T22:46:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58066.log 2024-09-14T22:46:44.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87350.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87350.log.gz 2024-09-14T22:46:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65557.log 2024-09-14T22:46:44.573 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58066.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58066.log.gz 2024-09-14T22:46:44.574 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95746.log 2024-09-14T22:46:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65557.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65557.log.gz 2024-09-14T22:46:44.575 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62677.log 2024-09-14T22:46:44.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95746.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95746.log.gz 2024-09-14T22:46:44.576 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92446.log 2024-09-14T22:46:44.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62677.log.gz 2024-09-14T22:46:44.576 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127524.log 2024-09-14T22:46:44.577 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92446.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117049.log 0.0% 2024-09-14T22:46:44.577 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.92446.log.gz 2024-09-14T22:46:44.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127524.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127524.log.gz 2024-09-14T22:46:44.578 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105459.log 2024-09-14T22:46:44.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117049.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117049.log.gz 2024-09-14T22:46:44.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133842.log 2024-09-14T22:46:44.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105459.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105459.log.gz 2024-09-14T22:46:44.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77208.log 2024-09-14T22:46:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133842.log.gz 2024-09-14T22:46:44.580 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137548.log 2024-09-14T22:46:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77208.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77208.log.gz 2024-09-14T22:46:44.581 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73071.log 2024-09-14T22:46:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137548.log.gz 2024-09-14T22:46:44.582 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114583.log 2024-09-14T22:46:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73071.log.gz 2024-09-14T22:46:44.583 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54340.log 2024-09-14T22:46:44.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114583.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106639.log 2024-09-14T22:46:44.584 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114583.log.gz 2024-09-14T22:46:44.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54340.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54340.log.gz 2024-09-14T22:46:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.48638.log 2024-09-14T22:46:44.585 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106639.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40059.log 2024-09-14T22:46:44.586 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106639.log.gz 2024-09-14T22:46:44.586 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.48638.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41624.log 2024-09-14T22:46:44.586 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.48638.log.gz 2024-09-14T22:46:44.587 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40059.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46451.log 2024-09-14T22:46:44.587 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40059.log.gz 2024-09-14T22:46:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41624.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41624.log.gz 2024-09-14T22:46:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150099.log 2024-09-14T22:46:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46451.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46451.log.gz 2024-09-14T22:46:44.588 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71031.log 2024-09-14T22:46:44.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150099.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150099.log.gz 2024-09-14T22:46:44.589 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97443.log 2024-09-14T22:46:44.590 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71031.log.gz 2024-09-14T22:46:44.590 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46679.log 2024-09-14T22:46:44.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97443.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116504.log 2024-09-14T22:46:44.591 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97443.log.gz 2024-09-14T22:46:44.591 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46679.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.46679.log.gz -5 2024-09-14T22:46:44.591 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.136081.log 2024-09-14T22:46:44.592 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116504.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116504.log.gz 2024-09-14T22:46:44.592 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96577.log 2024-09-14T22:46:44.593 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136081.log.gz 2024-09-14T22:46:44.593 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120789.log 2024-09-14T22:46:44.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96577.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96577.log.gz 2024-09-14T22:46:44.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135887.log 2024-09-14T22:46:44.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120789.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120789.log.gz 2024-09-14T22:46:44.595 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80492.log 2024-09-14T22:46:44.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135887.log.gz 2024-09-14T22:46:44.595 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131368.log 2024-09-14T22:46:44.596 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80492.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.admin.80492.log.gz -- 2024-09-14T22:46:44.596 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.123938.log 2024-09-14T22:46:44.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131368.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131368.log.gz 2024-09-14T22:46:44.597 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49801.log 2024-09-14T22:46:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123938.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123938.log.gz 2024-09-14T22:46:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139593.log 2024-09-14T22:46:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49801.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49801.log.gz 2024-09-14T22:46:44.599 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130654.log 2024-09-14T22:46:44.599 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139593.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.admin.139593.log.gz /var/log/ceph/cluster1-client.mirror.84642.log 2024-09-14T22:46:44.599 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130654.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130654.log.gz 2024-09-14T22:46:44.600 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34192.log 2024-09-14T22:46:44.601 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84642.log.gz 2024-09-14T22:46:44.601 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101372.log 2024-09-14T22:46:44.602 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34192.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34192.log.gz 2024-09-14T22:46:44.602 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61623.log 2024-09-14T22:46:44.602 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101372.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101372.log.gz 2024-09-14T22:46:44.603 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61775.log 2024-09-14T22:46:44.603 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61623.log.gz 2024-09-14T22:46:44.603 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144391.log 2024-09-14T22:46:44.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61775.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61775.log.gz 2024-09-14T22:46:44.604 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49381.log 2024-09-14T22:46:44.605 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144391.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66332.log 2024-09-14T22:46:44.605 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144391.log.gz 2024-09-14T22:46:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49381.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49381.log.gz 2024-09-14T22:46:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91660.log 2024-09-14T22:46:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66332.log.gz 2024-09-14T22:46:44.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101872.log 2024-09-14T22:46:44.607 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91660.log.gz 2024-09-14T22:46:44.607 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104492.log 2024-09-14T22:46:44.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101872.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86403.log 2024-09-14T22:46:44.608 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101872.log.gz 2024-09-14T22:46:44.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104492.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104492.log.gz 2024-09-14T22:46:44.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82933.log 2024-09-14T22:46:44.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86403.log.gz 2024-09-14T22:46:44.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83635.log 2024-09-14T22:46:44.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82933.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82933.log.gz 2024-09-14T22:46:44.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66708.log 2024-09-14T22:46:44.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83635.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83635.log.gz 2024-09-14T22:46:44.612 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.92997.log 2024-09-14T22:46:44.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66708.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66708.log.gz 2024-09-14T22:46:44.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132157.log 2024-09-14T22:46:44.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.92997.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.92997.log.gz 2024-09-14T22:46:44.614 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122952.log 2024-09-14T22:46:44.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132157.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132157.log.gz 2024-09-14T22:46:44.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65071.log 2024-09-14T22:46:44.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122952.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122952.log.gz 2024-09-14T22:46:44.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45717.log 2024-09-14T22:46:44.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65071.log.gz 2024-09-14T22:46:44.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114825.log 2024-09-14T22:46:44.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45717.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45717.log.gz 2024-09-14T22:46:44.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153166.log 2024-09-14T22:46:44.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114825.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114825.log.gz 2024-09-14T22:46:44.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62739.log 2024-09-14T22:46:44.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153166.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153166.log.gz 2024-09-14T22:46:44.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76956.log 2024-09-14T22:46:44.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62739.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62739.log.gz 2024-09-14T22:46:44.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139455.log 2024-09-14T22:46:44.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76956.log.gz 2024-09-14T22:46:44.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64108.log 2024-09-14T22:46:44.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139455.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139455.log.gz 2024-09-14T22:46:44.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78133.log 2024-09-14T22:46:44.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64108.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64108.log.gz 2024-09-14T22:46:44.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89327.log 2024-09-14T22:46:44.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78133.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78133.log.gz 2024-09-14T22:46:44.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53287.log 2024-09-14T22:46:44.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89327.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89327.log.gz 2024-09-14T22:46:44.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72859.log 2024-09-14T22:46:44.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53287.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53287.log.gz 2024-09-14T22:46:44.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142123.log 2024-09-14T22:46:44.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72859.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72859.log.gz 2024-09-14T22:46:44.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129789.log 2024-09-14T22:46:44.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142123.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142123.log.gz 2024-09-14T22:46:44.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85520.log 2024-09-14T22:46:44.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129789.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129789.log.gz 2024-09-14T22:46:44.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61355.log 2024-09-14T22:46:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85520.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85520.log.gz 2024-09-14T22:46:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62405.log 2024-09-14T22:46:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61355.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61355.log.gz 2024-09-14T22:46:44.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54421.log 2024-09-14T22:46:44.630 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62405.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62405.log.gz 2024-09-14T22:46:44.630 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47789.log 2024-09-14T22:46:44.631 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54421.log.gz 2024-09-14T22:46:44.631 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125050.log 2024-09-14T22:46:44.631 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47789.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47789.log.gz 2024-09-14T22:46:44.632 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134557.log 2024-09-14T22:46:44.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125050.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125050.log.gz 2024-09-14T22:46:44.633 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140718.log 2024-09-14T22:46:44.633 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134557.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134557.log.gz 2024-09-14T22:46:44.634 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120324.log 2024-09-14T22:46:44.634 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140718.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140718.log.gz 2024-09-14T22:46:44.635 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68230.log 2024-09-14T22:46:44.635 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120324.log.gz 2024-09-14T22:46:44.635 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87034.log 2024-09-14T22:46:44.636 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68230.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74350.log 2024-09-14T22:46:44.636 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68230.log.gz 2024-09-14T22:46:44.637 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87034.log.gz 2024-09-14T22:46:44.637 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95462.log 2024-09-14T22:46:44.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74350.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74350.log.gz 2024-09-14T22:46:44.638 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117635.log 2024-09-14T22:46:44.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95462.log.gz 2024-09-14T22:46:44.639 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152126.log 2024-09-14T22:46:44.639 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117635.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100112.log 2024-09-14T22:46:44.639 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117635.log.gz 2024-09-14T22:46:44.640 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152126.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152126.log.gz 2024-09-14T22:46:44.640 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104707.log 2024-09-14T22:46:44.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100112.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100112.log.gz 2024-09-14T22:46:44.641 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114514.log 2024-09-14T22:46:44.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104707.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104707.log.gz 2024-09-14T22:46:44.642 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49613.log 2024-09-14T22:46:44.642 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114514.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119271.log 2024-09-14T22:46:44.643 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114514.log.gz 2024-09-14T22:46:44.643 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49613.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49613.log.gz 2024-09-14T22:46:44.643 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144589.log 2024-09-14T22:46:44.644 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119271.log.gz 2024-09-14T22:46:44.644 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100908.log 2024-09-14T22:46:44.645 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144589.log.gz 2024-09-14T22:46:44.645 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40228.log 2024-09-14T22:46:44.646 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100908.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100908.log.gz 2024-09-14T22:46:44.646 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140056.log 2024-09-14T22:46:44.647 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40228.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40228.log.gz 2024-09-14T22:46:44.647 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99352.log 2024-09-14T22:46:44.648 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140056.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103880.log 2024-09-14T22:46:44.648 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140056.log.gz 2024-09-14T22:46:44.649 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99352.log.gz 2024-09-14T22:46:44.649 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96274.log 2024-09-14T22:46:44.650 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103880.log.gz 2024-09-14T22:46:44.650 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56247.log 2024-09-14T22:46:44.650 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96274.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96274.log.gz 2024-09-14T22:46:44.650 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148203.log 2024-09-14T22:46:44.651 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56247.log.gz 2024-09-14T22:46:44.651 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103837.log 2024-09-14T22:46:44.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148203.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148203.log.gz 2024-09-14T22:46:44.652 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72118.log 2024-09-14T22:46:44.653 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103837.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103837.log.gz 2024-09-14T22:46:44.653 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129835.log 2024-09-14T22:46:44.654 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72118.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72118.log.gz 2024-09-14T22:46:44.654 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49176.log 2024-09-14T22:46:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129835.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129835.log.gz 2024-09-14T22:46:44.655 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56276.log 2024-09-14T22:46:44.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49176.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137688.log 2024-09-14T22:46:44.656 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49176.log.gz 2024-09-14T22:46:44.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56276.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56276.log.gz 2024-09-14T22:46:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145598.log 2024-09-14T22:46:44.657 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137688.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137688.log.gz 2024-09-14T22:46:44.658 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111273.log 2024-09-14T22:46:44.658 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145598.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145598.log.gz 2024-09-14T22:46:44.658 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98872.log 2024-09-14T22:46:44.659 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111273.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111273.log.gz 2024-09-14T22:46:44.659 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.139869.log 2024-09-14T22:46:44.660 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98872.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98872.log.gz 2024-09-14T22:46:44.660 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94690.log 2024-09-14T22:46:44.661 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.139869.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.139869.log.gz 2024-09-14T22:46:44.661 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51693.log 2024-09-14T22:46:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94690.log.gz 2024-09-14T22:46:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109782.log 2024-09-14T22:46:44.662 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51693.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51693.log.gz 2024-09-14T22:46:44.663 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122530.log 2024-09-14T22:46:44.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109782.log.gz 2024-09-14T22:46:44.664 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143185.log 2024-09-14T22:46:44.664 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122530.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122530.log.gz 2024-09-14T22:46:44.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126059.log 2024-09-14T22:46:44.665 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143185.log.gz 2024-09-14T22:46:44.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63460.log 2024-09-14T22:46:44.666 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126059.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126059.log.gz 2024-09-14T22:46:44.666 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43402.log 2024-09-14T22:46:44.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63460.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63460.log.gz 2024-09-14T22:46:44.667 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.35707.log 2024-09-14T22:46:44.668 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43402.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43402.log.gz 2024-09-14T22:46:44.668 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61480.log 2024-09-14T22:46:44.668 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.35707.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.35707.log.gz 2024-09-14T22:46:44.668 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.106358.log 2024-09-14T22:46:44.669 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61480.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61480.log.gz 2024-09-14T22:46:44.669 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.34941.log 2024-09-14T22:46:44.670 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106358.log.gz 2024-09-14T22:46:44.670 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61438.log 2024-09-14T22:46:44.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.34941.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111886.log 2024-09-14T22:46:44.671 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.34941.log.gz 2024-09-14T22:46:44.672 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61438.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61438.log.gz 2024-09-14T22:46:44.672 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82497.log 2024-09-14T22:46:44.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111886.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111886.log.gz 2024-09-14T22:46:44.673 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76405.log 2024-09-14T22:46:44.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82497.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82497.log.gz 2024-09-14T22:46:44.673 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116505.log 2024-09-14T22:46:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76405.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76405.log.gz 2024-09-14T22:46:44.674 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135071.log 2024-09-14T22:46:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116505.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116505.log.gz 2024-09-14T22:46:44.675 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141296.log 2024-09-14T22:46:44.676 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135071.log.gz 2024-09-14T22:46:44.676 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77080.log 2024-09-14T22:46:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141296.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141296.log.gz 2024-09-14T22:46:44.677 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44770.log 2024-09-14T22:46:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77080.log.gz 2024-09-14T22:46:44.678 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140898.log 2024-09-14T22:46:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44770.log.gz 2024-09-14T22:46:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.32778.log 2024-09-14T22:46:44.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140898.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140898.log.gz 2024-09-14T22:46:44.680 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141269.log 2024-09-14T22:46:44.680 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.32778.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133241.log 2024-09-14T22:46:44.680 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.32778.log.gz 2024-09-14T22:46:44.681 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141269.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster2-client.admin.141269.log.gz -- 2024-09-14T22:46:44.681 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.88083.log 2024-09-14T22:46:44.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133241.log.gz 2024-09-14T22:46:44.682 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39847.log 2024-09-14T22:46:44.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88083.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88083.log.gz 2024-09-14T22:46:44.683 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39705.log 2024-09-14T22:46:44.683 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39847.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39847.log.gz 2024-09-14T22:46:44.683 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129470.log 2024-09-14T22:46:44.684 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39705.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39705.log.gz 2024-09-14T22:46:44.684 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57988.log 2024-09-14T22:46:44.685 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129470.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129470.log.gz 2024-09-14T22:46:44.685 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38589.log 2024-09-14T22:46:44.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57988.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57988.log.gz 2024-09-14T22:46:44.686 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87389.log 2024-09-14T22:46:44.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38589.log.gz 2024-09-14T22:46:44.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114703.log 2024-09-14T22:46:44.687 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87389.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87389.log.gz 2024-09-14T22:46:44.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62959.log 2024-09-14T22:46:44.688 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114703.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114703.log.gz 2024-09-14T22:46:44.688 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58770.log 2024-09-14T22:46:44.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62959.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62959.log.gz 2024-09-14T22:46:44.689 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80138.log 2024-09-14T22:46:44.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58770.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58770.log.gz 2024-09-14T22:46:44.689 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139285.log 2024-09-14T22:46:44.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80138.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80138.log.gz 2024-09-14T22:46:44.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85020.log 2024-09-14T22:46:44.691 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139285.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139285.log.gz 2024-09-14T22:46:44.691 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79984.log 2024-09-14T22:46:44.692 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85020.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85020.log.gz 2024-09-14T22:46:44.692 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88020.log 2024-09-14T22:46:44.692 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79984.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85478.log 2024-09-14T22:46:44.692 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79984.log.gz 2024-09-14T22:46:44.693 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88020.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88020.log.gz 2024-09-14T22:46:44.693 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152206.log 2024-09-14T22:46:44.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85478.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85478.log.gz 2024-09-14T22:46:44.694 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67962.log 2024-09-14T22:46:44.695 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152206.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152206.log.gz 2024-09-14T22:46:44.695 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74770.log 2024-09-14T22:46:44.695 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67962.log.gz 2024-09-14T22:46:44.696 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44189.log 2024-09-14T22:46:44.697 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74770.log.gz 2024-09-14T22:46:44.697 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136940.log 2024-09-14T22:46:44.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62087.log 2024-09-14T22:46:44.698 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44189.log.gz 2024-09-14T22:46:44.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136940.log.gz 2024-09-14T22:46:44.698 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75063.log 2024-09-14T22:46:44.699 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62087.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62087.log.gz 2024-09-14T22:46:44.699 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105153.log 2024-09-14T22:46:44.700 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75063.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75063.log.gz 2024-09-14T22:46:44.700 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98178.log 2024-09-14T22:46:44.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105153.log.gz 2024-09-14T22:46:44.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72607.log 2024-09-14T22:46:44.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98178.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98178.log.gz 2024-09-14T22:46:44.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60998.log 2024-09-14T22:46:44.702 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72607.log.gz 2024-09-14T22:46:44.703 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108319.log 2024-09-14T22:46:44.703 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60998.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.130952.log -- replaced with /var/log/ceph/cluster1-client.mirror.60998.log.gz 2024-09-14T22:46:44.703 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.704 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108319.log.gz 2024-09-14T22:46:44.704 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111464.log 2024-09-14T22:46:44.705 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130952.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130952.log.gz 2024-09-14T22:46:44.705 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75442.log 2024-09-14T22:46:44.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111464.log.gz 2024-09-14T22:46:44.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99061.log 2024-09-14T22:46:44.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75442.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75442.log.gz 2024-09-14T22:46:44.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65973.log 2024-09-14T22:46:44.707 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99061.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99061.log.gz 2024-09-14T22:46:44.707 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133800.log 2024-09-14T22:46:44.708 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65973.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65973.log.gz 2024-09-14T22:46:44.708 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58656.log 2024-09-14T22:46:44.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133800.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133800.log.gz 2024-09-14T22:46:44.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81209.log 2024-09-14T22:46:44.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58656.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58656.log.gz 2024-09-14T22:46:44.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102043.log 2024-09-14T22:46:44.710 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81209.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78091.log 2024-09-14T22:46:44.710 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81209.log.gz 2024-09-14T22:46:44.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102043.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102043.log.gz 2024-09-14T22:46:44.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75103.log 2024-09-14T22:46:44.712 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78091.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113678.log 2024-09-14T22:46:44.712 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78091.log.gz 2024-09-14T22:46:44.713 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75103.log.gz 2024-09-14T22:46:44.713 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60153.log 2024-09-14T22:46:44.714 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113678.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113678.log.gz 2024-09-14T22:46:44.714 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50727.log 2024-09-14T22:46:44.715 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60153.log.gz 2024-09-14T22:46:44.715 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101311.log 2024-09-14T22:46:44.715 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50727.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92800.log 2024-09-14T22:46:44.715 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50727.log.gz 2024-09-14T22:46:44.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101311.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101311.log.gz 2024-09-14T22:46:44.716 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154230.log 2024-09-14T22:46:44.717 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92800.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92800.log.gz 2024-09-14T22:46:44.717 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95068.log 2024-09-14T22:46:44.718 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154230.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154230.log.gz 2024-09-14T22:46:44.718 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56463.log 2024-09-14T22:46:44.718 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95068.log.gz 2024-09-14T22:46:44.718 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86928.log 2024-09-14T22:46:44.719 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56463.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56463.log.gz 2024-09-14T22:46:44.719 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81296.log 2024-09-14T22:46:44.720 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86928.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67698.log 2024-09-14T22:46:44.720 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86928.log.gz 2024-09-14T22:46:44.721 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81296.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81296.log.gz 2024-09-14T22:46:44.721 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40414.log 2024-09-14T22:46:44.721 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67698.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72903.log 2024-09-14T22:46:44.721 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67698.log.gz 2024-09-14T22:46:44.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40414.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40414.log.gz 2024-09-14T22:46:44.722 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36719.log 2024-09-14T22:46:44.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72903.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39052.log 2024-09-14T22:46:44.723 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72903.log.gz 2024-09-14T22:46:44.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36719.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36719.log.gz 2024-09-14T22:46:44.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46336.log 2024-09-14T22:46:44.725 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39052.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39052.log.gz 2024-09-14T22:46:44.725 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140619.log 2024-09-14T22:46:44.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46336.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46336.log.gz 2024-09-14T22:46:44.726 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83345.log 2024-09-14T22:46:44.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140619.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140619.log.gz 2024-09-14T22:46:44.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143338.log 2024-09-14T22:46:44.727 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83345.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83345.log.gz 2024-09-14T22:46:44.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58200.log 2024-09-14T22:46:44.728 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143338.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143338.log.gz 2024-09-14T22:46:44.728 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69550.log 2024-09-14T22:46:44.729 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58200.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58200.log.gz 2024-09-14T22:46:44.729 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75739.log 2024-09-14T22:46:44.729 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69550.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77252.log 2024-09-14T22:46:44.730 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69550.log.gz 2024-09-14T22:46:44.730 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122109.log/var/log/ceph/cluster1-client.mirror.75739.log: 2024-09-14T22:46:44.730 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75739.log.gz 2024-09-14T22:46:44.731 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77252.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77252.log.gz 2024-09-14T22:46:44.731 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129416.log 2024-09-14T22:46:44.732 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122109.log.gz 2024-09-14T22:46:44.732 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134180.log 2024-09-14T22:46:44.733 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129416.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129416.log.gz 2024-09-14T22:46:44.733 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144383.log 2024-09-14T22:46:44.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134180.log.gz 2024-09-14T22:46:44.734 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115748.log 2024-09-14T22:46:44.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144383.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144383.log.gz 2024-09-14T22:46:44.734 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122446.log 2024-09-14T22:46:44.735 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115748.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115748.log.gz 2024-09-14T22:46:44.735 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91683.log 2024-09-14T22:46:44.736 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122446.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122446.log.gz 2024-09-14T22:46:44.736 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39346.log 2024-09-14T22:46:44.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91683.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91683.log.gz 2024-09-14T22:46:44.737 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92909.log 2024-09-14T22:46:44.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39346.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39346.log.gz 2024-09-14T22:46:44.737 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92542.log 2024-09-14T22:46:44.738 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92909.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92909.log.gz 2024-09-14T22:46:44.738 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50533.log 2024-09-14T22:46:44.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92542.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92542.log.gz 2024-09-14T22:46:44.739 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37807.log 2024-09-14T22:46:44.740 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50533.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50533.log.gz 2024-09-14T22:46:44.740 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141123.log 2024-09-14T22:46:44.741 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37807.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.admin.92543.log -- replaced with /var/log/ceph/cluster1-client.mirror.37807.log.gz 2024-09-14T22:46:44.741 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141123.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141123.log.gz 2024-09-14T22:46:44.742 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123791.log 2024-09-14T22:46:44.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92543.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87939.log 2024-09-14T22:46:44.742 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92543.log.gz 2024-09-14T22:46:44.743 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123791.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123791.log.gz 2024-09-14T22:46:44.743 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117860.log 2024-09-14T22:46:44.744 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87939.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87939.log.gz 2024-09-14T22:46:44.744 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113752.log 2024-09-14T22:46:44.745 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117860.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117860.log.gz 2024-09-14T22:46:44.745 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121542.log 2024-09-14T22:46:44.746 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113752.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113752.log.gz 2024-09-14T22:46:44.746 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143573.log 2024-09-14T22:46:44.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121542.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121542.log.gz 2024-09-14T22:46:44.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154659.log 2024-09-14T22:46:44.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143573.log.gz 2024-09-14T22:46:44.748 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137969.log 2024-09-14T22:46:44.748 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154659.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85123.log 2024-09-14T22:46:44.749 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154659.log.gz 2024-09-14T22:46:44.749 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137969.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137969.log.gz 2024-09-14T22:46:44.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38508.log 2024-09-14T22:46:44.750 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85123.log.gz 2024-09-14T22:46:44.750 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98932.log 2024-09-14T22:46:44.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38508.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38508.log.gz 2024-09-14T22:46:44.751 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51946.log 2024-09-14T22:46:44.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98932.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65346.log 2024-09-14T22:46:44.751 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98932.log.gz 2024-09-14T22:46:44.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51946.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65004.log 2024-09-14T22:46:44.752 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51946.log.gz 2024-09-14T22:46:44.753 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65346.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.79411.log 2024-09-14T22:46:44.753 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.65346.log.gz 2024-09-14T22:46:44.754 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65004.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65004.log.gz 2024-09-14T22:46:44.754 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138515.log 2024-09-14T22:46:44.754 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79411.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79411.log.gz 2024-09-14T22:46:44.755 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96752.log 2024-09-14T22:46:44.755 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138515.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.68397.log 2024-09-14T22:46:44.756 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138515.log.gz 2024-09-14T22:46:44.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96752.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96752.log.gz 2024-09-14T22:46:44.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75609.log 2024-09-14T22:46:44.757 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.68397.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.68397.log.gz 2024-09-14T22:46:44.757 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57252.log 2024-09-14T22:46:44.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75609.log.gz 2024-09-14T22:46:44.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102733.log 2024-09-14T22:46:44.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57252.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57252.log.gz 2024-09-14T22:46:44.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.154029.log 2024-09-14T22:46:44.759 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102733.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102733.log.gz 2024-09-14T22:46:44.759 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.155035.log 2024-09-14T22:46:44.760 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.154029.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.154029.log.gz 2024-09-14T22:46:44.760 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-osd.0.log 2024-09-14T22:46:44.761 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.155035.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.155035.log.gz 2024-09-14T22:46:44.761 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104153.log 2024-09-14T22:46:44.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-osd.0.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41698.log 2024-09-14T22:46:44.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104153.log.gz 2024-09-14T22:46:44.763 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88986.log 2024-09-14T22:46:44.763 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41698.log.gz 2024-09-14T22:46:44.763 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37534.log 2024-09-14T22:46:44.764 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88986.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.88986.log.gz 2024-09-14T22:46:44.764 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147149.log 2024-09-14T22:46:44.765 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37534.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37534.log.gz 2024-09-14T22:46:44.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107338.log 2024-09-14T22:46:44.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147149.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.147149.log.gz 2024-09-14T22:46:44.769 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49068.log 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107338.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107338.log.gz 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125156.log 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49068.log.gz 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150882.log 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125156.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.125156.log.gz -- 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.52960.log 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150882.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150882.log.gz 2024-09-14T22:46:44.770 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63402.log 2024-09-14T22:46:44.771 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52960.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134306.log 2024-09-14T22:46:44.771 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52960.log.gz 2024-09-14T22:46:44.771 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63402.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63402.log.gz 2024-09-14T22:46:44.772 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123160.log 2024-09-14T22:46:44.772 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134306.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.70300.log 2024-09-14T22:46:44.772 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.134306.log.gz 2024-09-14T22:46:44.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123160.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123160.log.gz 2024-09-14T22:46:44.773 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121861.log 2024-09-14T22:46:44.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70300.log.gz 2024-09-14T22:46:44.773 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94763.log 2024-09-14T22:46:44.774 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121861.log.gz 2024-09-14T22:46:44.774 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53500.log 2024-09-14T22:46:44.774 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94763.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94763.log.gz 2024-09-14T22:46:44.774 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83213.log 2024-09-14T22:46:44.775 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53500.log.gz 2024-09-14T22:46:44.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86319.log 2024-09-14T22:46:44.776 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83213.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83213.log.gz 2024-09-14T22:46:44.776 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93848.log 2024-09-14T22:46:44.777 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86319.log.gz 2024-09-14T22:46:44.777 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82228.log 2024-09-14T22:46:44.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93848.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93848.log.gz 2024-09-14T22:46:44.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35033.log 2024-09-14T22:46:44.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82228.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82228.log.gz 2024-09-14T22:46:44.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137588.log 2024-09-14T22:46:44.779 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35033.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35033.log.gz 2024-09-14T22:46:44.779 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94509.log 2024-09-14T22:46:44.780 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137588.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137588.log.gz 2024-09-14T22:46:44.780 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85856.log 2024-09-14T22:46:44.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94509.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94509.log.gz 2024-09-14T22:46:44.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65138.log 2024-09-14T22:46:44.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85856.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85856.log.gz 2024-09-14T22:46:44.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117595.log 2024-09-14T22:46:44.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65138.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.65138.log.gz --verbose 2024-09-14T22:46:44.782 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.admin.81489.log 2024-09-14T22:46:44.783 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117595.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117595.log.gz 2024-09-14T22:46:44.783 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72580.log 2024-09-14T22:46:44.783 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81489.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81489.log.gz -5 2024-09-14T22:46:44.784 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.52215.log 2024-09-14T22:46:44.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72580.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72580.log.gz 2024-09-14T22:46:44.785 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140893.log 2024-09-14T22:46:44.785 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52215.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52215.log.gz 2024-09-14T22:46:44.785 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116659.log 2024-09-14T22:46:44.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140893.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140893.log.gz 2024-09-14T22:46:44.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43772.log 2024-09-14T22:46:44.787 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116659.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116659.log.gz 2024-09-14T22:46:44.787 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.105841.log 2024-09-14T22:46:44.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43772.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123478.log 2024-09-14T22:46:44.788 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43772.log.gz 2024-09-14T22:46:44.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.105841.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.105841.log.gz 2024-09-14T22:46:44.788 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58040.log 2024-09-14T22:46:44.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123478.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123478.log.gz 2024-09-14T22:46:44.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42885.log 2024-09-14T22:46:44.790 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58040.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58040.log.gz 2024-09-14T22:46:44.790 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148328.log 2024-09-14T22:46:44.791 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42885.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126086.log 2024-09-14T22:46:44.791 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42885.log.gz 2024-09-14T22:46:44.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148328.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148328.log.gz 2024-09-14T22:46:44.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136246.log 2024-09-14T22:46:44.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126086.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126086.log.gz 2024-09-14T22:46:44.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62464.log 2024-09-14T22:46:44.793 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136246.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136246.log.gz 2024-09-14T22:46:44.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128189.log 2024-09-14T22:46:44.794 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62464.log.gz 2024-09-14T22:46:44.794 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153801.log 2024-09-14T22:46:44.795 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128189.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37429.log 2024-09-14T22:46:44.795 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128189.log.gz 2024-09-14T22:46:44.795 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153801.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153801.log.gz 2024-09-14T22:46:44.796 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115935.log 2024-09-14T22:46:44.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37429.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37429.log.gz 2024-09-14T22:46:44.797 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78448.log 2024-09-14T22:46:44.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115935.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115935.log.gz 2024-09-14T22:46:44.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72296.log 2024-09-14T22:46:44.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78448.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78448.log.gz 2024-09-14T22:46:44.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133214.log 2024-09-14T22:46:44.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72296.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147677.log 2024-09-14T22:46:44.799 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72296.log.gz 2024-09-14T22:46:44.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133214.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133214.log.gz 2024-09-14T22:46:44.799 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75944.log 2024-09-14T22:46:44.800 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147677.log.gz 2024-09-14T22:46:44.800 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110553.log 2024-09-14T22:46:44.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75944.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75944.log.gzgzip 2024-09-14T22:46:44.801 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130271.log 2024-09-14T22:46:44.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110553.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110553.log.gz 2024-09-14T22:46:44.802 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47658.log 2024-09-14T22:46:44.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130271.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130271.log.gz 2024-09-14T22:46:44.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37056.log 2024-09-14T22:46:44.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47658.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47658.log.gz 2024-09-14T22:46:44.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86194.log 2024-09-14T22:46:44.804 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37056.log: 0.0%gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69004.log 2024-09-14T22:46:44.805 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.37056.log.gz 2024-09-14T22:46:44.805 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86194.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86194.log.gz 2024-09-14T22:46:44.805 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51407.log 2024-09-14T22:46:44.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69004.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.admin.69004.log.gz --verbose 2024-09-14T22:46:44.806 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.49718.log 2024-09-14T22:46:44.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51407.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51407.log.gz 2024-09-14T22:46:44.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116435.log 2024-09-14T22:46:44.807 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49718.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49718.log.gz 2024-09-14T22:46:44.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101454.log 2024-09-14T22:46:44.808 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116435.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.59211.log 2024-09-14T22:46:44.808 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.mirror.116435.log.gz 2024-09-14T22:46:44.809 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101454.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101454.log.gz 2024-09-14T22:46:44.809 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143684.log 2024-09-14T22:46:44.809 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59211.log.gz 2024-09-14T22:46:44.810 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139011.log 2024-09-14T22:46:44.811 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143684.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143684.log.gz 2024-09-14T22:46:44.811 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57949.log 2024-09-14T22:46:44.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139011.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139011.log.gz 2024-09-14T22:46:44.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141553.log 2024-09-14T22:46:44.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57949.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57949.log.gz 2024-09-14T22:46:44.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52741.log 2024-09-14T22:46:44.813 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141553.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.mirror.141553.log.gz --verbose -- 2024-09-14T22:46:44.813 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.130245.log 2024-09-14T22:46:44.814 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52741.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.52741.log.gz 2024-09-14T22:46:44.814 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109258.log 2024-09-14T22:46:44.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130245.log.gz 2024-09-14T22:46:44.815 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90121.log 2024-09-14T22:46:44.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109258.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.109258.log.gz /var/log/ceph/cluster1-client.mirror.48859.log 2024-09-14T22:46:44.816 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.816 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90121.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90121.log.gz 2024-09-14T22:46:44.817 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104479.log 2024-09-14T22:46:44.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48859.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48859.log.gz 2024-09-14T22:46:44.817 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150315.log 2024-09-14T22:46:44.818 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104479.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37953.log 2024-09-14T22:46:44.818 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104479.log.gz 2024-09-14T22:46:44.819 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150315.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150315.log.gz 2024-09-14T22:46:44.819 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89659.log 2024-09-14T22:46:44.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37953.log.gz 2024-09-14T22:46:44.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109929.log 2024-09-14T22:46:44.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89659.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89659.log.gz 2024-09-14T22:46:44.821 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101745.log 2024-09-14T22:46:44.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109929.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109929.log.gz 2024-09-14T22:46:44.822 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.96336.log 2024-09-14T22:46:44.823 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101745.log.gz 2024-09-14T22:46:44.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84095.log 2024-09-14T22:46:44.823 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.96336.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.96336.log.gz 2024-09-14T22:46:44.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95220.log 2024-09-14T22:46:44.824 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84095.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87769.log 2024-09-14T22:46:44.824 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84095.log.gz 2024-09-14T22:46:44.825 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95220.log.gz 2024-09-14T22:46:44.825 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139351.log 2024-09-14T22:46:44.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87769.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.87769.log.gz /var/log/ceph/cluster1-client.mirror.86466.log 2024-09-14T22:46:44.826 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.827 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139351.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139351.log.gz 2024-09-14T22:46:44.827 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96668.log 2024-09-14T22:46:44.827 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86466.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86466.log.gz 2024-09-14T22:46:44.828 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38170.log 2024-09-14T22:46:44.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96668.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96668.log.gz 2024-09-14T22:46:44.829 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97761.log 2024-09-14T22:46:44.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38170.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38170.log.gz 2024-09-14T22:46:44.830 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126383.log 2024-09-14T22:46:44.830 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97761.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97761.log.gz 2024-09-14T22:46:44.830 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87661.log 2024-09-14T22:46:44.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126383.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126383.log.gz 2024-09-14T22:46:44.831 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118959.log 2024-09-14T22:46:44.832 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87661.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87661.log.gz 2024-09-14T22:46:44.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125323.log 2024-09-14T22:46:44.833 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118959.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118959.log.gz 2024-09-14T22:46:44.833 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148622.log 2024-09-14T22:46:44.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125323.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.125323.log.gz 2024-09-14T22:46:44.834 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125676.log 2024-09-14T22:46:44.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148622.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148622.log.gz 2024-09-14T22:46:44.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102359.log 2024-09-14T22:46:44.835 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125676.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125676.log.gz 2024-09-14T22:46:44.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151036.log 2024-09-14T22:46:44.836 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102359.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151463.log 2024-09-14T22:46:44.836 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102359.log.gz 2024-09-14T22:46:44.837 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151036.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151036.log.gz 2024-09-14T22:46:44.837 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122637.log 2024-09-14T22:46:44.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151463.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151463.log.gz 2024-09-14T22:46:44.838 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67523.log 2024-09-14T22:46:44.839 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122637.log.gz 2024-09-14T22:46:44.839 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37956.log 2024-09-14T22:46:44.840 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67523.log.gz 2024-09-14T22:46:44.840 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130359.log 2024-09-14T22:46:44.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37956.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37956.log.gz 2024-09-14T22:46:44.841 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86150.log 2024-09-14T22:46:44.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130359.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130359.log.gz 2024-09-14T22:46:44.842 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81645.log 2024-09-14T22:46:44.842 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86150.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.86150.log.gz --verbose 2024-09-14T22:46:44.842 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.87521.log 2024-09-14T22:46:44.843 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81645.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81645.log.gz 2024-09-14T22:46:44.843 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62594.log 2024-09-14T22:46:44.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87521.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71422.log 2024-09-14T22:46:44.844 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87521.log.gz 2024-09-14T22:46:44.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62594.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62594.log.gz 2024-09-14T22:46:44.845 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111024.log 2024-09-14T22:46:44.845 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71422.log.gzgzip 2024-09-14T22:46:44.845 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41107.log 2024-09-14T22:46:44.846 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111024.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111024.log.gz 2024-09-14T22:46:44.846 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68894.log 2024-09-14T22:46:44.847 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41107.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41107.log.gz 2024-09-14T22:46:44.847 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105673.log 2024-09-14T22:46:44.847 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68894.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68894.log.gz 2024-09-14T22:46:44.848 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133465.log 2024-09-14T22:46:44.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105673.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.admin.105673.log.gz --verbose -- 2024-09-14T22:46:44.848 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.149671.log 2024-09-14T22:46:44.849 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133465.log.gz 2024-09-14T22:46:44.850 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138283.log 2024-09-14T22:46:44.850 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149671.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149671.log.gz 2024-09-14T22:46:44.850 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58086.log 2024-09-14T22:46:44.851 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138283.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.138283.log.gz --verbose -- 2024-09-14T22:46:44.851 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster2-client.mirror.153599.log 2024-09-14T22:46:44.852 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58086.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58086.log.gz 2024-09-14T22:46:44.852 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35489.log 2024-09-14T22:46:44.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153599.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153599.log.gz 2024-09-14T22:46:44.853 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83724.log 2024-09-14T22:46:44.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35489.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35489.log.gz 2024-09-14T22:46:44.853 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124715.log 2024-09-14T22:46:44.854 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83724.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83724.log.gz 2024-09-14T22:46:44.854 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146950.log 2024-09-14T22:46:44.855 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124715.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124715.log.gz 2024-09-14T22:46:44.855 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50452.log 2024-09-14T22:46:44.856 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146950.log.gz 2024-09-14T22:46:44.856 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142164.log 2024-09-14T22:46:44.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50452.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50452.log.gz 2024-09-14T22:46:44.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64716.log 2024-09-14T22:46:44.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142164.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142164.log.gz 2024-09-14T22:46:44.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38547.log 2024-09-14T22:46:44.858 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64716.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64716.log.gz 2024-09-14T22:46:44.858 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47280.log 2024-09-14T22:46:44.859 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38547.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38547.log.gz 2024-09-14T22:46:44.859 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41802.log 2024-09-14T22:46:44.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47280.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47280.log.gz 2024-09-14T22:46:44.860 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44080.log 2024-09-14T22:46:44.861 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41802.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41802.log.gz 2024-09-14T22:46:44.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148095.log 2024-09-14T22:46:44.861 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44080.log.gz 2024-09-14T22:46:44.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59152.log 2024-09-14T22:46:44.862 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148095.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148095.log.gz 2024-09-14T22:46:44.862 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39908.log 2024-09-14T22:46:44.863 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59152.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59152.log.gz 2024-09-14T22:46:44.863 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124171.log 2024-09-14T22:46:44.864 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39908.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39908.log.gz 2024-09-14T22:46:44.864 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84031.log 2024-09-14T22:46:44.865 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124171.log.gz 2024-09-14T22:46:44.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86046.log 2024-09-14T22:46:44.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84031.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.52825.log -- replaced with /var/log/ceph/cluster1-client.mirror.84031.log.gz 2024-09-14T22:46:44.866 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86046.log.gz 2024-09-14T22:46:44.867 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110013.log 2024-09-14T22:46:44.867 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52825.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.52825.log.gz -5 --verbose 2024-09-14T22:46:44.867 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.admin.129061.log 2024-09-14T22:46:44.868 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110013.log.gz 2024-09-14T22:46:44.868 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109864.log 2024-09-14T22:46:44.869 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129061.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129061.log.gz 2024-09-14T22:46:44.869 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101515.log 2024-09-14T22:46:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109864.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109864.log.gz 2024-09-14T22:46:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63688.log 2024-09-14T22:46:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101515.log.gz 2024-09-14T22:46:44.871 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47462.log 2024-09-14T22:46:44.871 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63688.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120909.log 2024-09-14T22:46:44.872 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63688.log.gz 2024-09-14T22:46:44.872 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47462.log.gz 2024-09-14T22:46:44.872 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118316.log 2024-09-14T22:46:44.873 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120909.log.gz 2024-09-14T22:46:44.873 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36547.log 2024-09-14T22:46:44.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118316.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118316.log.gz 2024-09-14T22:46:44.874 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53542.log 2024-09-14T22:46:44.875 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36547.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36547.log.gz 2024-09-14T22:46:44.875 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154283.log 2024-09-14T22:46:44.876 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53542.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53542.log.gz 2024-09-14T22:46:44.876 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89745.log 2024-09-14T22:46:44.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154283.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.154283.log.gz 2024-09-14T22:46:44.877 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54297.log 2024-09-14T22:46:44.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89745.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147185.log 2024-09-14T22:46:44.877 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89745.log.gz 2024-09-14T22:46:44.878 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54297.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54297.log.gz 2024-09-14T22:46:44.878 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132227.log 2024-09-14T22:46:44.879 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147185.log.gz 2024-09-14T22:46:44.879 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51106.log 2024-09-14T22:46:44.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132227.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106499.log 2024-09-14T22:46:44.880 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132227.log.gz 2024-09-14T22:46:44.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51106.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51106.log.gz 2024-09-14T22:46:44.881 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143183.log 2024-09-14T22:46:44.881 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106499.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99771.log 2024-09-14T22:46:44.881 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106499.log.gz 2024-09-14T22:46:44.882 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143183.log.gz 2024-09-14T22:46:44.882 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46880.log 2024-09-14T22:46:44.883 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99771.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153827.log 2024-09-14T22:46:44.883 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99771.log.gz 2024-09-14T22:46:44.884 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46880.log.gz 2024-09-14T22:46:44.884 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130198.log 2024-09-14T22:46:44.885 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153827.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153827.log.gz 2024-09-14T22:46:44.885 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62888.log 2024-09-14T22:46:44.885 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130198.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39051.log 2024-09-14T22:46:44.885 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130198.log.gz 2024-09-14T22:46:44.886 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62888.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62888.log.gz 2024-09-14T22:46:44.886 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153257.log 2024-09-14T22:46:44.887 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39051.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.144012.log 2024-09-14T22:46:44.888 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.39051.log.gz 2024-09-14T22:46:44.888 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153257.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153257.log.gz 2024-09-14T22:46:44.888 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66848.log 2024-09-14T22:46:44.889 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144012.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113333.log 2024-09-14T22:46:44.889 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144012.log.gz 2024-09-14T22:46:44.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66848.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66848.log.gz 2024-09-14T22:46:44.890 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151233.log 2024-09-14T22:46:44.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113333.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113333.log.gz 2024-09-14T22:46:44.891 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99270.log 2024-09-14T22:46:44.891 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151233.log.gz 2024-09-14T22:46:44.892 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47728.log 2024-09-14T22:46:44.892 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99270.log.gz 2024-09-14T22:46:44.892 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153640.log 2024-09-14T22:46:44.893 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47728.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47728.log.gz 2024-09-14T22:46:44.893 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68556.log 2024-09-14T22:46:44.894 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153640.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153640.log.gz 2024-09-14T22:46:44.894 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69160.log 2024-09-14T22:46:44.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68556.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68556.log.gz 2024-09-14T22:46:44.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.57519.log 2024-09-14T22:46:44.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69160.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69160.log.gz 2024-09-14T22:46:44.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127370.log 2024-09-14T22:46:44.896 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.57519.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37263.log 2024-09-14T22:46:44.896 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.57519.log.gz 2024-09-14T22:46:44.897 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127370.log.gz 2024-09-14T22:46:44.897 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153391.log 2024-09-14T22:46:44.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37263.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37263.log.gz 2024-09-14T22:46:44.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110391.log 2024-09-14T22:46:44.899 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153391.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153391.log.gz 2024-09-14T22:46:44.899 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146517.log 2024-09-14T22:46:44.899 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110391.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110391.log.gz 2024-09-14T22:46:44.899 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122531.log 2024-09-14T22:46:44.900 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146517.log.gz 2024-09-14T22:46:44.900 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130218.log 2024-09-14T22:46:44.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122531.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140379.log 2024-09-14T22:46:44.901 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122531.log.gz 2024-09-14T22:46:44.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130218.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130218.log.gz 2024-09-14T22:46:44.902 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44233.log 2024-09-14T22:46:44.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140379.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54003.log 2024-09-14T22:46:44.902 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140379.log.gz 2024-09-14T22:46:44.903 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44233.log.gz 2024-09-14T22:46:44.903 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127119.log 2024-09-14T22:46:44.904 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54003.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144590.log 0.0% 2024-09-14T22:46:44.904 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.54003.log.gz 2024-09-14T22:46:44.905 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127119.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127119.log.gz 2024-09-14T22:46:44.905 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50243.log 2024-09-14T22:46:44.906 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144590.log.gz 2024-09-14T22:46:44.906 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46652.log 2024-09-14T22:46:44.906 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50243.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50243.log.gz 2024-09-14T22:46:44.906 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70507.log 2024-09-14T22:46:44.907 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46652.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46652.log.gz 2024-09-14T22:46:44.907 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96605.log 2024-09-14T22:46:44.908 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70507.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70507.log.gz 2024-09-14T22:46:44.908 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134220.log 2024-09-14T22:46:44.909 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96605.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96605.log.gz 2024-09-14T22:46:44.909 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61900.log 2024-09-14T22:46:44.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134220.log.gz 2024-09-14T22:46:44.910 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78949.log 2024-09-14T22:46:44.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61900.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.61900.log.gz -5 2024-09-14T22:46:44.911 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.101729.log 2024-09-14T22:46:44.912 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78949.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78949.log.gz 2024-09-14T22:46:44.912 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.129970.log 2024-09-14T22:46:44.912 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101729.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101729.log.gz 2024-09-14T22:46:44.912 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40205.log 2024-09-14T22:46:44.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.129970.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.129970.log.gz 2024-09-14T22:46:44.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73445.log 2024-09-14T22:46:44.914 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40205.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40205.log.gz 2024-09-14T22:46:44.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125324.log 2024-09-14T22:46:44.915 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73445.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73445.log.gz 2024-09-14T22:46:44.915 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42656.log 2024-09-14T22:46:44.916 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125324.log.gz 2024-09-14T22:46:44.916 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62489.log 2024-09-14T22:46:44.916 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42656.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42656.log.gz 2024-09-14T22:46:44.916 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113876.log 2024-09-14T22:46:44.917 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62489.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62489.log.gz 2024-09-14T22:46:44.917 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54129.log 2024-09-14T22:46:44.918 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113876.log.gz 2024-09-14T22:46:44.918 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123476.log 2024-09-14T22:46:44.919 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54129.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54129.log.gz 2024-09-14T22:46:44.919 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120952.log 2024-09-14T22:46:44.919 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123476.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123476.log.gz 2024-09-14T22:46:44.920 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120297.log 2024-09-14T22:46:44.920 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120952.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120952.log.gz 2024-09-14T22:46:44.920 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136165.log 2024-09-14T22:46:44.921 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120297.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120297.log.gz 2024-09-14T22:46:44.921 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129218.log 2024-09-14T22:46:44.922 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136165.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136165.log.gz 2024-09-14T22:46:44.922 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132394.log 2024-09-14T22:46:44.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129218.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.129218.log.gz 2024-09-14T22:46:44.923 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73488.log 2024-09-14T22:46:44.924 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132394.log.gz 2024-09-14T22:46:44.924 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124779.log 2024-09-14T22:46:44.924 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73488.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73488.log.gz 2024-09-14T22:46:44.924 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134177.log 2024-09-14T22:46:44.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124779.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124779.log.gz 2024-09-14T22:46:44.925 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100895.log 2024-09-14T22:46:44.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134177.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62849.log 2024-09-14T22:46:44.926 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134177.log.gz 2024-09-14T22:46:44.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100895.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100895.log.gz 2024-09-14T22:46:44.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125552.log 2024-09-14T22:46:44.927 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62849.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85877.log 2024-09-14T22:46:44.927 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62849.log.gz 2024-09-14T22:46:44.928 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125552.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126831.log 2024-09-14T22:46:44.928 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125552.log.gz 2024-09-14T22:46:44.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85877.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50221.log 2024-09-14T22:46:44.929 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85877.log.gz 2024-09-14T22:46:44.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126831.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.admin.126831.log.gz -- 2024-09-14T22:46:44.929 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.39595.log 2024-09-14T22:46:44.930 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50221.log.gz 2024-09-14T22:46:44.930 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62362.log 2024-09-14T22:46:44.931 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39595.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39595.log.gz 2024-09-14T22:46:44.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143881.log 2024-09-14T22:46:44.932 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62362.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44873.log 2024-09-14T22:46:44.932 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62362.log.gz 2024-09-14T22:46:44.932 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143881.log.gz 2024-09-14T22:46:44.933 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96729.log 2024-09-14T22:46:44.933 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44873.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44873.log.gz 2024-09-14T22:46:44.933 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64777.log 2024-09-14T22:46:44.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96729.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120787.log 2024-09-14T22:46:44.934 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96729.log.gz 2024-09-14T22:46:44.935 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64777.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64777.log.gz 2024-09-14T22:46:44.935 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75064.log 2024-09-14T22:46:44.936 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120787.log.gz 2024-09-14T22:46:44.936 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37053.log 2024-09-14T22:46:44.937 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75064.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105698.log 2024-09-14T22:46:44.937 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75064.log.gz 2024-09-14T22:46:44.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37053.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37053.log.gz 2024-09-14T22:46:44.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74771.log 2024-09-14T22:46:44.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105698.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105698.log.gz 2024-09-14T22:46:44.939 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59431.log 2024-09-14T22:46:44.939 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74771.log.gz 2024-09-14T22:46:44.939 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60687.log 2024-09-14T22:46:44.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59431.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142392.log 2024-09-14T22:46:44.940 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59431.log.gz 2024-09-14T22:46:44.941 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60687.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60687.log.gz 2024-09-14T22:46:44.941 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71812.log 2024-09-14T22:46:44.941 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142392.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142392.log.gz 2024-09-14T22:46:44.942 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.83026.log 2024-09-14T22:46:44.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71812.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96816.log 2024-09-14T22:46:44.943 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71812.log.gz 2024-09-14T22:46:44.943 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.83026.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.83026.log.gz 2024-09-14T22:46:44.943 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77500.log 2024-09-14T22:46:44.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96816.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96816.log.gz 2024-09-14T22:46:44.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38294.log 2024-09-14T22:46:44.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77500.log.gz 2024-09-14T22:46:44.945 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148725.log 2024-09-14T22:46:44.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38294.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38294.log.gz 2024-09-14T22:46:44.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71004.log 2024-09-14T22:46:44.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148725.log.gz 2024-09-14T22:46:44.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122909.log 2024-09-14T22:46:44.947 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71004.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71004.log.gz 2024-09-14T22:46:44.947 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114635.log 2024-09-14T22:46:44.948 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122909.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122909.log.gz 2024-09-14T22:46:44.948 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153546.log 2024-09-14T22:46:44.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114635.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114635.log.gz 2024-09-14T22:46:44.949 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136373.log 2024-09-14T22:46:44.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153546.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153546.log.gz 2024-09-14T22:46:44.950 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70373.log 2024-09-14T22:46:44.950 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136373.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136373.log.gz 2024-09-14T22:46:44.950 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43599.log 2024-09-14T22:46:44.951 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70373.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70373.log.gz 2024-09-14T22:46:44.951 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130978.log 2024-09-14T22:46:44.952 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43599.log.gz 2024-09-14T22:46:44.952 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64358.log 2024-09-14T22:46:44.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130978.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130978.log.gz 2024-09-14T22:46:44.953 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126725.log 2024-09-14T22:46:44.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64358.log.gz 2024-09-14T22:46:44.953 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139033.log 2024-09-14T22:46:44.954 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126725.log.gz 2024-09-14T22:46:44.954 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144990.log 2024-09-14T22:46:44.955 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139033.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139033.log.gz 2024-09-14T22:46:44.955 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54814.log 2024-09-14T22:46:44.956 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144990.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144990.log.gz 2024-09-14T22:46:44.956 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45691.log 2024-09-14T22:46:44.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54814.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54814.log.gz 2024-09-14T22:46:44.957 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89743.log 2024-09-14T22:46:44.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45691.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.97715.log -- replaced with /var/log/ceph/cluster2-client.admin.45691.log.gz 2024-09-14T22:46:44.957 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:44.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89743.log.gz 2024-09-14T22:46:44.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73951.log 2024-09-14T22:46:44.959 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97715.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97715.log.gz 2024-09-14T22:46:44.959 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63456.log 2024-09-14T22:46:44.960 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73951.log.gz 2024-09-14T22:46:44.960 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54466.log 2024-09-14T22:46:44.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63456.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63456.log.gz 2024-09-14T22:46:44.961 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48400.log 2024-09-14T22:46:44.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54466.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54466.log.gz 2024-09-14T22:46:44.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138516.log 2024-09-14T22:46:44.962 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48400.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74962.log 2024-09-14T22:46:44.962 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48400.log.gz 2024-09-14T22:46:44.963 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138516.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138516.log.gz 2024-09-14T22:46:44.963 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97904.log 2024-09-14T22:46:44.964 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74962.log.gz 2024-09-14T22:46:44.964 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118109.log 2024-09-14T22:46:44.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97904.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97904.log.gz 2024-09-14T22:46:44.965 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46424.log 2024-09-14T22:46:44.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118109.log.gz 2024-09-14T22:46:44.965 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112429.log 2024-09-14T22:46:44.966 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46424.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46424.log.gz 2024-09-14T22:46:44.966 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.144037.log 2024-09-14T22:46:44.967 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112429.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154415.log 0.0% 2024-09-14T22:46:44.967 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.112429.log.gz 2024-09-14T22:46:44.967 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.144037.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.144037.log.gz 2024-09-14T22:46:44.968 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144302.log 2024-09-14T22:46:44.968 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154415.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154415.log.gz 2024-09-14T22:46:44.968 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90747.log 2024-09-14T22:46:44.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144302.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144302.log.gzgzip 2024-09-14T22:46:44.969 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137801.log 2024-09-14T22:46:44.970 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90747.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90747.log.gz 2024-09-14T22:46:44.970 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92015.log 2024-09-14T22:46:44.971 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.72034.log 2024-09-14T22:46:44.971 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137801.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137801.log.gz 2024-09-14T22:46:44.971 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92015.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44697.log 2024-09-14T22:46:44.972 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92015.log.gz 2024-09-14T22:46:44.972 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.72034.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.72034.log.gz 2024-09-14T22:46:44.972 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86110.log 2024-09-14T22:46:44.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44697.log.gz 2024-09-14T22:46:44.973 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121819.log 2024-09-14T22:46:44.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86110.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97090.log 2024-09-14T22:46:44.977 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86110.log.gz 2024-09-14T22:46:44.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121819.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.121819.log.gz 2024-09-14T22:46:44.977 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39217.log 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97090.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97090.log.gz 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51736.log 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39217.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.39217.log.gz -- 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.131567.log 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51736.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51736.log.gz 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117700.log 2024-09-14T22:46:44.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131567.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131567.log.gz 2024-09-14T22:46:44.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102623.log 2024-09-14T22:46:44.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117700.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117700.log.gz 2024-09-14T22:46:44.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145637.log 2024-09-14T22:46:44.980 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102623.log.gz 2024-09-14T22:46:44.980 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90082.log 2024-09-14T22:46:44.980 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145637.log.gz 2024-09-14T22:46:44.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66331.log 2024-09-14T22:46:44.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90082.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90082.log.gz 2024-09-14T22:46:44.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84529.log 2024-09-14T22:46:44.982 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66331.log.gz 2024-09-14T22:46:44.982 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123939.log 2024-09-14T22:46:44.983 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84529.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84529.log.gz 2024-09-14T22:46:44.983 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148623.log 2024-09-14T22:46:44.983 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123939.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112660.log 2024-09-14T22:46:44.984 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123939.log.gz 2024-09-14T22:46:44.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148623.log.gz 2024-09-14T22:46:44.984 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77251.log 2024-09-14T22:46:44.985 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112660.log.gz 2024-09-14T22:46:44.985 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74304.log 2024-09-14T22:46:44.986 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77251.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77251.log.gz 2024-09-14T22:46:44.986 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58241.log 2024-09-14T22:46:44.987 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74304.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74304.log.gz 2024-09-14T22:46:44.987 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115468.log 2024-09-14T22:46:44.988 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58241.log.gz 2024-09-14T22:46:44.988 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.56705.log 2024-09-14T22:46:44.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115468.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115468.log.gz 2024-09-14T22:46:44.989 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144299.log 2024-09-14T22:46:44.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.56705.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.56705.log.gz 2024-09-14T22:46:44.989 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133696.log 2024-09-14T22:46:44.990 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144299.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144299.log.gz 2024-09-14T22:46:44.990 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143594.log 2024-09-14T22:46:44.991 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133696.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133696.log.gz 2024-09-14T22:46:44.991 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58542.log 2024-09-14T22:46:44.992 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143594.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143594.log.gz 2024-09-14T22:46:44.992 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.128568.log 2024-09-14T22:46:44.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58542.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58542.log.gz 2024-09-14T22:46:44.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120649.log 2024-09-14T22:46:44.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.128568.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.128568.log.gz 2024-09-14T22:46:44.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139395.log 2024-09-14T22:46:44.994 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120649.log.gz 2024-09-14T22:46:44.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40119.log 2024-09-14T22:46:44.995 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139395.log.gz 2024-09-14T22:46:44.995 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78235.log 2024-09-14T22:46:44.996 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40119.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40119.log.gz 2024-09-14T22:46:44.996 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115683.log 2024-09-14T22:46:44.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78235.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78235.log.gz 2024-09-14T22:46:44.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139722.log 2024-09-14T22:46:44.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115683.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115683.log.gz 2024-09-14T22:46:44.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54591.log 2024-09-14T22:46:44.999 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139722.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139722.log.gz 2024-09-14T22:46:44.999 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49425.log 2024-09-14T22:46:44.999 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54591.log.gz 2024-09-14T22:46:44.999 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98390.log 2024-09-14T22:46:45.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49425.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49425.log.gz 2024-09-14T22:46:45.000 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124422.log 2024-09-14T22:46:45.001 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98390.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98390.log.gz 2024-09-14T22:46:45.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85982.log 2024-09-14T22:46:45.001 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124422.log.gz 2024-09-14T22:46:45.002 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63555.log 2024-09-14T22:46:45.002 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85982.log.gz 2024-09-14T22:46:45.002 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88082.log 2024-09-14T22:46:45.003 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63555.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63555.log.gz 2024-09-14T22:46:45.003 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81889.log 2024-09-14T22:46:45.004 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88082.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88082.log.gz 2024-09-14T22:46:45.004 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94307.log 2024-09-14T22:46:45.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81889.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81889.log.gz 2024-09-14T22:46:45.005 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98749.log 2024-09-14T22:46:45.006 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94307.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94307.log.gz 2024-09-14T22:46:45.006 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75803.log 2024-09-14T22:46:45.006 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98749.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98749.log.gz 2024-09-14T22:46:45.006 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41196.log 2024-09-14T22:46:45.007 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75803.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97965.log 2024-09-14T22:46:45.007 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75803.log.gz 2024-09-14T22:46:45.008 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41196.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41196.log.gz 2024-09-14T22:46:45.008 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71264.log 2024-09-14T22:46:45.009 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97965.log.gz 2024-09-14T22:46:45.009 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129013.log 2024-09-14T22:46:45.009 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71264.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.71264.log.gz 2024-09-14T22:46:45.010 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.45786.log 2024-09-14T22:46:45.010 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129013.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89328.log 0.0% 2024-09-14T22:46:45.010 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.129013.log.gz 2024-09-14T22:46:45.011 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45786.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45786.log.gz 2024-09-14T22:46:45.011 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137357.log 2024-09-14T22:46:45.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89328.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89328.log.gz 2024-09-14T22:46:45.012 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39806.log 2024-09-14T22:46:45.013 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137357.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137357.log.gz 2024-09-14T22:46:45.013 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69435.log 2024-09-14T22:46:45.014 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39806.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39806.log.gz 2024-09-14T22:46:45.014 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86171.log 2024-09-14T22:46:45.014 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69435.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69435.log.gz 2024-09-14T22:46:45.014 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113081.log 2024-09-14T22:46:45.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86171.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77626.log 2024-09-14T22:46:45.015 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86171.log.gz 2024-09-14T22:46:45.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113081.log.gz 2024-09-14T22:46:45.016 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48965.log 2024-09-14T22:46:45.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77626.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77626.log.gz 2024-09-14T22:46:45.017 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132502.log 2024-09-14T22:46:45.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48965.log.gz 2024-09-14T22:46:45.018 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67788.log 2024-09-14T22:46:45.018 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132502.log.gz 2024-09-14T22:46:45.019 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76742.log 2024-09-14T22:46:45.019 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67788.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50686.log 2024-09-14T22:46:45.019 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67788.log.gz 2024-09-14T22:46:45.020 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76742.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.76742.log.gz --verbose -- 2024-09-14T22:46:45.020 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.96817.log 2024-09-14T22:46:45.021 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50686.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50686.log.gz 2024-09-14T22:46:45.021 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42759.log 2024-09-14T22:46:45.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96817.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96817.log.gz 2024-09-14T22:46:45.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111444.log 2024-09-14T22:46:45.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42759.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42759.log.gz 2024-09-14T22:46:45.023 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131332.log 2024-09-14T22:46:45.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111444.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111444.log.gz 2024-09-14T22:46:45.024 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137217.log 2024-09-14T22:46:45.024 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131332.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.55099.log 2024-09-14T22:46:45.024 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131332.log.gz 2024-09-14T22:46:45.025 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137217.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137217.log.gz 2024-09-14T22:46:45.025 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125894.log 2024-09-14T22:46:45.026 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.55099.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.55099.log.gz 2024-09-14T22:46:45.026 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149166.log 2024-09-14T22:46:45.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125894.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.125894.log.gz /var/log/ceph/cluster1-client.mirror.84852.log 2024-09-14T22:46:45.027 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149166.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149166.log.gz 2024-09-14T22:46:45.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52533.log 2024-09-14T22:46:45.028 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84852.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84852.log.gz 2024-09-14T22:46:45.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56625.log 2024-09-14T22:46:45.029 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52533.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95488.log 2024-09-14T22:46:45.029 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52533.log.gz 2024-09-14T22:46:45.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56625.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56625.log.gz 2024-09-14T22:46:45.030 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101249.log 2024-09-14T22:46:45.031 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95488.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95488.log.gzgzip 2024-09-14T22:46:45.031 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.141216.log 2024-09-14T22:46:45.031 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101249.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101249.log.gz 2024-09-14T22:46:45.032 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105929.log 2024-09-14T22:46:45.032 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141216.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141216.log.gz 2024-09-14T22:46:45.032 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71553.log 2024-09-14T22:46:45.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105929.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105929.log.gz 2024-09-14T22:46:45.033 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59526.log 2024-09-14T22:46:45.034 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71553.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71553.log.gz 2024-09-14T22:46:45.034 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73529.log 2024-09-14T22:46:45.035 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59526.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59526.log.gz 2024-09-14T22:46:45.035 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112830.log 2024-09-14T22:46:45.035 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73529.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73529.log.gz 2024-09-14T22:46:45.036 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146901.log 2024-09-14T22:46:45.036 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112830.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112830.log.gz 2024-09-14T22:46:45.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80609.log 2024-09-14T22:46:45.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152345.log 2024-09-14T22:46:45.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146901.log.gz 2024-09-14T22:46:45.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80609.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80609.log.gz 2024-09-14T22:46:45.038 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99289.log 2024-09-14T22:46:45.039 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152345.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152345.log.gz 2024-09-14T22:46:45.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96272.log 2024-09-14T22:46:45.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99289.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99289.log.gz 2024-09-14T22:46:45.040 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40417.log 2024-09-14T22:46:45.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96272.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96272.log.gz 2024-09-14T22:46:45.041 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154911.log 2024-09-14T22:46:45.041 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40417.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40417.log.gz 2024-09-14T22:46:45.041 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78003.log 2024-09-14T22:46:45.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154911.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154911.log.gz 2024-09-14T22:46:45.042 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89530.log 2024-09-14T22:46:45.043 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78003.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78003.log.gz 2024-09-14T22:46:45.043 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107841.log 2024-09-14T22:46:45.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89530.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89530.log.gz 2024-09-14T22:46:45.044 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153961.log 2024-09-14T22:46:45.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107841.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107841.log.gz 2024-09-14T22:46:45.044 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77293.log 2024-09-14T22:46:45.045 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153961.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153961.log.gz 2024-09-14T22:46:45.045 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131868.log 2024-09-14T22:46:45.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77293.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77293.log.gz 2024-09-14T22:46:45.046 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88317.log 2024-09-14T22:46:45.047 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131868.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131868.log.gz 2024-09-14T22:46:45.047 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36045.log 2024-09-14T22:46:45.047 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88317.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88317.log.gz 2024-09-14T22:46:45.048 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90038.log 2024-09-14T22:46:45.048 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36045.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36045.log.gzgzip 2024-09-14T22:46:45.048 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114279.log 2024-09-14T22:46:45.049 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90038.log.gz 2024-09-14T22:46:45.049 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91728.log 2024-09-14T22:46:45.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114279.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114279.log.gz 2024-09-14T22:46:45.050 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50492.log 2024-09-14T22:46:45.051 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91728.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91728.log.gz 2024-09-14T22:46:45.051 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152958.log 2024-09-14T22:46:45.052 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50492.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50492.log.gz 2024-09-14T22:46:45.052 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61000.log 2024-09-14T22:46:45.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152958.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39281.log 2024-09-14T22:46:45.053 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152958.log.gz 2024-09-14T22:46:45.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61000.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61000.log.gz 2024-09-14T22:46:45.053 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148665.log 2024-09-14T22:46:45.054 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39281.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39281.log.gz 2024-09-14T22:46:45.054 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128610.log 2024-09-14T22:46:45.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148665.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148665.log.gz 2024-09-14T22:46:45.055 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85748.log 2024-09-14T22:46:45.056 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128610.log.gz 2024-09-14T22:46:45.056 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109530.log 2024-09-14T22:46:45.056 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85748.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85748.log.gz 2024-09-14T22:46:45.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71685.log 2024-09-14T22:46:45.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109530.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42051.log 2024-09-14T22:46:45.057 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109530.log.gz 2024-09-14T22:46:45.058 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71685.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71685.log.gz 2024-09-14T22:46:45.058 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71358.log 2024-09-14T22:46:45.059 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42051.log.gz 2024-09-14T22:46:45.059 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96603.log 2024-09-14T22:46:45.059 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71358.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71358.log.gz 2024-09-14T22:46:45.060 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96420.log 2024-09-14T22:46:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96603.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96603.log.gz 2024-09-14T22:46:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121554.log 2024-09-14T22:46:45.061 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96420.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.96420.log.gz -5 2024-09-14T22:46:45.061 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.38674.log 2024-09-14T22:46:45.062 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121554.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121554.log.gz 2024-09-14T22:46:45.062 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125785.log 2024-09-14T22:46:45.063 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38674.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38674.log.gz 2024-09-14T22:46:45.063 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63120.log 2024-09-14T22:46:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125785.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125785.log.gz 2024-09-14T22:46:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38085.log 2024-09-14T22:46:45.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63120.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.63120.log.gz -5 --verbose 2024-09-14T22:46:45.064 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.88777.log 2024-09-14T22:46:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38085.log.gz 2024-09-14T22:46:45.065 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114670.log 2024-09-14T22:46:45.066 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88777.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91355.log 2024-09-14T22:46:45.066 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88777.log.gz 2024-09-14T22:46:45.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114670.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144926.log 2024-09-14T22:46:45.067 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114670.log.gz 2024-09-14T22:46:45.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91355.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91355.log.gz 2024-09-14T22:46:45.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61062.log 2024-09-14T22:46:45.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144926.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144926.log.gz 2024-09-14T22:46:45.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62573.log 2024-09-14T22:46:45.069 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61062.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85187.log 2024-09-14T22:46:45.069 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61062.log.gz 2024-09-14T22:46:45.070 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62573.log.gz 2024-09-14T22:46:45.070 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48861.log 2024-09-14T22:46:45.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85187.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.93912.log 2024-09-14T22:46:45.071 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85187.log.gz 2024-09-14T22:46:45.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48861.log.gz 2024-09-14T22:46:45.071 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59589.log 2024-09-14T22:46:45.072 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.93912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.93912.log.gz 2024-09-14T22:46:45.072 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100050.log 2024-09-14T22:46:45.073 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59589.log.gz 2024-09-14T22:46:45.073 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144802.log 2024-09-14T22:46:45.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100050.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100050.log.gz 2024-09-14T22:46:45.074 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93900.log 2024-09-14T22:46:45.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144802.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.148663.log 2024-09-14T22:46:45.074 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.144802.log.gz 2024-09-14T22:46:45.075 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93900.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93900.log.gz 2024-09-14T22:46:45.075 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73676.log 2024-09-14T22:46:45.076 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148663.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126770.log 2024-09-14T22:46:45.076 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148663.log.gz 2024-09-14T22:46:45.077 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73676.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73676.log.gz 2024-09-14T22:46:45.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136880.log 2024-09-14T22:46:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126770.log.gz 2024-09-14T22:46:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121038.log 2024-09-14T22:46:45.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136880.log.gz 2024-09-14T22:46:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74683.log 2024-09-14T22:46:45.079 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121038.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121038.log.gz 2024-09-14T22:46:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134733.log 2024-09-14T22:46:45.080 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74683.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130633.log 2024-09-14T22:46:45.080 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74683.log.gz 2024-09-14T22:46:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134733.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134733.log.gz 2024-09-14T22:46:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41319.log 2024-09-14T22:46:45.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130633.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130633.log.gz 2024-09-14T22:46:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146124.log 2024-09-14T22:46:45.082 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41319.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.41319.log.gz -5 --verbose 2024-09-14T22:46:45.082 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.admin.104066.log 2024-09-14T22:46:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146124.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146124.log.gz 2024-09-14T22:46:45.083 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75234.log 2024-09-14T22:46:45.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104066.log.gz 2024-09-14T22:46:45.084 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.93082.log 2024-09-14T22:46:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75234.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75234.log.gz 2024-09-14T22:46:45.085 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75484.log 2024-09-14T22:46:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.93082.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42718.log 2024-09-14T22:46:45.086 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.93082.log.gz 2024-09-14T22:46:45.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75484.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75484.log.gz 2024-09-14T22:46:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112532.log 2024-09-14T22:46:45.087 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42718.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44090.log 2024-09-14T22:46:45.087 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42718.log.gz 2024-09-14T22:46:45.088 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112532.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112532.log.gz 2024-09-14T22:46:45.088 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40184.log 2024-09-14T22:46:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44090.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109235.log 2024-09-14T22:46:45.089 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44090.log.gz 2024-09-14T22:46:45.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40184.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40184.log.gz 2024-09-14T22:46:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104152.log 2024-09-14T22:46:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109235.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109235.log.gz 2024-09-14T22:46:45.090 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58268.log 2024-09-14T22:46:45.091 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104152.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73320.log 2024-09-14T22:46:45.091 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104152.log.gz 2024-09-14T22:46:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58268.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58268.log.gz 2024-09-14T22:46:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124737.log 2024-09-14T22:46:45.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73320.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73320.log.gz 2024-09-14T22:46:45.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97172.log 2024-09-14T22:46:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124737.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124737.log.gz 2024-09-14T22:46:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109593.log 2024-09-14T22:46:45.094 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97172.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97172.log.gz 2024-09-14T22:46:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153231.log 2024-09-14T22:46:45.095 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109593.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109593.log.gz 2024-09-14T22:46:45.096 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113252.log 2024-09-14T22:46:45.096 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153231.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153231.log.gz 2024-09-14T22:46:45.096 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79500.log 2024-09-14T22:46:45.097 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113252.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45904.log 2024-09-14T22:46:45.097 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113252.log.gz 2024-09-14T22:46:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79500.log.gz 2024-09-14T22:46:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87663.log 2024-09-14T22:46:45.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45904.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.142963.log -- replaced with /var/log/ceph/cluster2-client.admin.45904.log.gz 2024-09-14T22:46:45.099 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.099 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87663.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87663.log.gz 2024-09-14T22:46:45.099 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130405.log 2024-09-14T22:46:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142963.log.gz 2024-09-14T22:46:45.100 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147171.log 2024-09-14T22:46:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130405.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130405.log.gz 2024-09-14T22:46:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122197.log 2024-09-14T22:46:45.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147171.log.gz 2024-09-14T22:46:45.102 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142097.log 2024-09-14T22:46:45.102 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122197.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122197.log.gz 2024-09-14T22:46:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100051.log 2024-09-14T22:46:45.103 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142097.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142097.log.gz 2024-09-14T22:46:45.104 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58864.log 2024-09-14T22:46:45.104 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100051.log.gz 2024-09-14T22:46:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101396.log 2024-09-14T22:46:45.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58864.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58864.log.gzgzip 2024-09-14T22:46:45.105 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61606.log 2024-09-14T22:46:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101396.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101396.log.gz 2024-09-14T22:46:45.106 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112132.log 2024-09-14T22:46:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61606.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61606.log.gz 2024-09-14T22:46:45.107 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135921.log 2024-09-14T22:46:45.108 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112132.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112132.log.gz 2024-09-14T22:46:45.108 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137422.log 2024-09-14T22:46:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135921.log.gz 2024-09-14T22:46:45.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149847.log 2024-09-14T22:46:45.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137422.log.gz 2024-09-14T22:46:45.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51565.log 2024-09-14T22:46:45.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149847.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149847.log.gz 2024-09-14T22:46:45.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70005.log 2024-09-14T22:46:45.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51565.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.51565.log.gz -5 --verbose -- /var/log/ceph/cluster1-client.admin.79831.log 2024-09-14T22:46:45.111 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70005.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70005.log.gz 2024-09-14T22:46:45.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44502.log 2024-09-14T22:46:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79831.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84916.log 2024-09-14T22:46:45.113 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79831.log.gz 2024-09-14T22:46:45.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44502.log.gz 2024-09-14T22:46:45.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.84136.log 2024-09-14T22:46:45.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84916.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84916.log.gz 2024-09-14T22:46:45.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70145.log 2024-09-14T22:46:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.84136.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.84136.log.gz 2024-09-14T22:46:45.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146123.log 2024-09-14T22:46:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70145.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70145.log.gz 2024-09-14T22:46:45.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138305.log 2024-09-14T22:46:45.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146123.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146123.log.gz 2024-09-14T22:46:45.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44826.log 2024-09-14T22:46:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138305.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138305.log.gz 2024-09-14T22:46:45.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132047.log 2024-09-14T22:46:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44826.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44826.log.gz 2024-09-14T22:46:45.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114212.log 2024-09-14T22:46:45.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132047.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132047.log.gz 2024-09-14T22:46:45.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149692.log 2024-09-14T22:46:45.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114212.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114212.log.gz 2024-09-14T22:46:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49844.log 2024-09-14T22:46:45.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149692.log.gz 2024-09-14T22:46:45.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62048.log 2024-09-14T22:46:45.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49844.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49844.log.gz 2024-09-14T22:46:45.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43859.log 2024-09-14T22:46:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62048.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62048.log.gz 2024-09-14T22:46:45.123 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134904.log 2024-09-14T22:46:45.124 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43859.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43859.log.gz 2024-09-14T22:46:45.124 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109068.log 2024-09-14T22:46:45.125 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134904.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134904.log.gz 2024-09-14T22:46:45.125 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111275.log 2024-09-14T22:46:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109068.log.gz 2024-09-14T22:46:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86636.log 2024-09-14T22:46:45.126 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111275.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111275.log.gz 2024-09-14T22:46:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110830.log 2024-09-14T22:46:45.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86636.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86636.log.gz 2024-09-14T22:46:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121545.log 2024-09-14T22:46:45.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110830.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110830.log.gzgzip 2024-09-14T22:46:45.128 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.68006.log 2024-09-14T22:46:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121545.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121545.log.gz 2024-09-14T22:46:45.129 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89782.log 2024-09-14T22:46:45.130 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68006.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68006.log.gz 2024-09-14T22:46:45.130 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112386.log 2024-09-14T22:46:45.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89782.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89782.log.gz 2024-09-14T22:46:45.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60306.log 2024-09-14T22:46:45.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112386.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112386.log.gz 2024-09-14T22:46:45.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137761.log 2024-09-14T22:46:45.133 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60306.log.gz 2024-09-14T22:46:45.133 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39845.log 2024-09-14T22:46:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137761.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137761.log.gz 2024-09-14T22:46:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84356.log 2024-09-14T22:46:45.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39845.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39845.log.gz 2024-09-14T22:46:45.135 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50179.log 2024-09-14T22:46:45.135 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84356.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84356.log.gz 2024-09-14T22:46:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115528.log 2024-09-14T22:46:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50179.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50179.log.gz 2024-09-14T22:46:45.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148472.log 2024-09-14T22:46:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115528.log.gz 2024-09-14T22:46:45.137 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49069.log 2024-09-14T22:46:45.138 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148472.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148472.log.gz 2024-09-14T22:46:45.138 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82819.log 2024-09-14T22:46:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49069.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49069.log.gz 2024-09-14T22:46:45.139 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88146.log 2024-09-14T22:46:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82819.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82819.log.gz 2024-09-14T22:46:45.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43350.log 2024-09-14T22:46:45.141 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88146.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88146.log.gz 2024-09-14T22:46:45.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70621.log 2024-09-14T22:46:45.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43350.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43350.log.gz 2024-09-14T22:46:45.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75741.log 2024-09-14T22:46:45.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70621.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111692.log 2024-09-14T22:46:45.143 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70621.log.gz 2024-09-14T22:46:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75741.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75741.log.gz 2024-09-14T22:46:45.143 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134968.log 2024-09-14T22:46:45.144 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111692.log.gz 2024-09-14T22:46:45.144 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124948.log 2024-09-14T22:46:45.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134968.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134968.log.gz 2024-09-14T22:46:45.145 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130519.log 2024-09-14T22:46:45.146 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124948.log.gz 2024-09-14T22:46:45.146 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60180.log 2024-09-14T22:46:45.147 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130519.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130519.log.gz 2024-09-14T22:46:45.147 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145180.log 2024-09-14T22:46:45.148 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60180.log.gz 2024-09-14T22:46:45.148 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82021.log 2024-09-14T22:46:45.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145180.log.gz 2024-09-14T22:46:45.149 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134008.log 2024-09-14T22:46:45.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82021.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82021.log.gz 2024-09-14T22:46:45.150 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70528.log 2024-09-14T22:46:45.150 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134008.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134008.log.gz 2024-09-14T22:46:45.150 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61106.log 2024-09-14T22:46:45.151 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70528.log.gz 2024-09-14T22:46:45.151 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106069.log 2024-09-14T22:46:45.152 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61106.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61106.log.gz 2024-09-14T22:46:45.152 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.81927.log 2024-09-14T22:46:45.153 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106069.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106069.log.gz 2024-09-14T22:46:45.153 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62278.log 2024-09-14T22:46:45.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.81927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.81927.log.gz 2024-09-14T22:46:45.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113080.log 2024-09-14T22:46:45.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62278.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62278.log.gz 2024-09-14T22:46:45.155 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79940.log 2024-09-14T22:46:45.156 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113080.log.gz 2024-09-14T22:46:45.156 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47944.log 2024-09-14T22:46:45.157 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79940.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79940.log.gz 2024-09-14T22:46:45.157 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48512.log 2024-09-14T22:46:45.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47944.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47944.log.gz 2024-09-14T22:46:45.158 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.154189.log 2024-09-14T22:46:45.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48512.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98430.log 2024-09-14T22:46:45.159 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48512.log.gz 2024-09-14T22:46:45.159 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.154189.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.154189.log.gz 2024-09-14T22:46:45.159 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67230.log 2024-09-14T22:46:45.160 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98430.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98430.log.gz 2024-09-14T22:46:45.160 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.93939.log 2024-09-14T22:46:45.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67230.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67230.log.gz 2024-09-14T22:46:45.161 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45406.log 2024-09-14T22:46:45.162 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.93939.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.93939.log.gz 2024-09-14T22:46:45.162 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133296.log 2024-09-14T22:46:45.163 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45406.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45406.log.gz 2024-09-14T22:46:45.163 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45407.log 2024-09-14T22:46:45.164 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133296.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133296.log.gz 2024-09-14T22:46:45.164 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80494.log 2024-09-14T22:46:45.165 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45407.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45407.log.gz 2024-09-14T22:46:45.165 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51525.log 2024-09-14T22:46:45.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80494.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64715.log 2024-09-14T22:46:45.166 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80494.log.gz 2024-09-14T22:46:45.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51525.log.gz 2024-09-14T22:46:45.167 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45349.log 2024-09-14T22:46:45.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64715.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.64715.log.gz -- /var/log/ceph/cluster1-client.mirror.64820.log 2024-09-14T22:46:45.167 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.168 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45349.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45349.log.gz 2024-09-14T22:46:45.168 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43391.log 2024-09-14T22:46:45.169 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64820.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64820.log.gz 2024-09-14T22:46:45.169 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-mon.a.log 2024-09-14T22:46:45.169 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43391.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43391.log.gz 2024-09-14T22:46:45.170 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97883.log 2024-09-14T22:46:45.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-mon.a.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111549.log 2024-09-14T22:46:45.171 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97883.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97883.log.gz 2024-09-14T22:46:45.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59347.log 2024-09-14T22:46:45.172 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111549.log.gz 2024-09-14T22:46:45.172 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103772.log 2024-09-14T22:46:45.173 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59347.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59347.log.gz 2024-09-14T22:46:45.173 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50725.log 2024-09-14T22:46:45.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103772.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103772.log.gz 2024-09-14T22:46:45.174 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102360.log 2024-09-14T22:46:45.175 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50725.log.gz 2024-09-14T22:46:45.175 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57211.log 2024-09-14T22:46:45.176 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102360.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102360.log.gz 2024-09-14T22:46:45.176 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146041.log 2024-09-14T22:46:45.177 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57211.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57211.log.gz 2024-09-14T22:46:45.177 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56822.log 2024-09-14T22:46:45.177 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146041.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146041.log.gz 2024-09-14T22:46:45.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47764.log 2024-09-14T22:46:45.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56822.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56822.log.gz 2024-09-14T22:46:45.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55868.log 2024-09-14T22:46:45.179 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47764.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47764.log.gz 2024-09-14T22:46:45.180 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.108189.log 2024-09-14T22:46:45.180 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55868.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55868.log.gz 2024-09-14T22:46:45.180 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54001.log 2024-09-14T22:46:45.181 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.108189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.108189.log.gz 2024-09-14T22:46:45.181 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84979.log 2024-09-14T22:46:45.182 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54001.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54001.log.gz 2024-09-14T22:46:45.182 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63371.log 2024-09-14T22:46:45.183 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84979.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84979.log.gz 2024-09-14T22:46:45.183 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129444.log 2024-09-14T22:46:45.184 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63371.log.gz 2024-09-14T22:46:45.184 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98555.log 2024-09-14T22:46:45.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129444.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129444.log.gz 2024-09-14T22:46:45.185 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36722.log 2024-09-14T22:46:45.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98555.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98555.log.gz 2024-09-14T22:46:45.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141641.log 2024-09-14T22:46:45.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36722.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36722.log.gz 2024-09-14T22:46:45.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.46019.log 2024-09-14T22:46:45.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141641.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141641.log.gz 2024-09-14T22:46:45.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50769.log 2024-09-14T22:46:45.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.46019.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.46019.log.gz 2024-09-14T22:46:45.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101453.log 2024-09-14T22:46:45.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50769.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50769.log.gz 2024-09-14T22:46:45.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116010.log 2024-09-14T22:46:45.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101453.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101453.log.gz 2024-09-14T22:46:45.190 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108609.log 2024-09-14T22:46:45.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116010.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116010.log.gz 2024-09-14T22:46:45.191 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84393.log 2024-09-14T22:46:45.191 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108609.log.gz 2024-09-14T22:46:45.191 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63759.log 2024-09-14T22:46:45.192 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84393.log.gz 2024-09-14T22:46:45.192 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52532.log 2024-09-14T22:46:45.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63759.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63759.log.gz 2024-09-14T22:46:45.193 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95330.log 2024-09-14T22:46:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52532.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52532.log.gz 2024-09-14T22:46:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80415.log 2024-09-14T22:46:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95330.log.gz 2024-09-14T22:46:45.194 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86535.log 2024-09-14T22:46:45.195 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80415.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80415.log.gz 2024-09-14T22:46:45.195 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117840.log 2024-09-14T22:46:45.196 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86535.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86535.log.gz 2024-09-14T22:46:45.196 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93332.log 2024-09-14T22:46:45.197 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117840.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117840.log.gz 2024-09-14T22:46:45.197 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.92983.log 2024-09-14T22:46:45.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93332.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93332.log.gz 2024-09-14T22:46:45.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104575.log 2024-09-14T22:46:45.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.92983.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.92983.log.gz 2024-09-14T22:46:45.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77541.log 2024-09-14T22:46:45.199 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104575.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104575.log.gzgzip 2024-09-14T22:46:45.199 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136544.log 2024-09-14T22:46:45.200 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77541.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77541.log.gz 2024-09-14T22:46:45.200 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113669.log 2024-09-14T22:46:45.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136544.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136544.log.gz 2024-09-14T22:46:45.201 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58905.log 2024-09-14T22:46:45.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113669.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113669.log.gz 2024-09-14T22:46:45.202 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104260.log 2024-09-14T22:46:45.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58905.log.gz 2024-09-14T22:46:45.203 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74156.log 2024-09-14T22:46:45.203 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104260.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104260.log.gz 2024-09-14T22:46:45.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111419.log 2024-09-14T22:46:45.204 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74156.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74156.log.gz 2024-09-14T22:46:45.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61543.log 2024-09-14T22:46:45.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111419.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111419.log.gz 2024-09-14T22:46:45.205 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47238.log 2024-09-14T22:46:45.206 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61543.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40689.log 2024-09-14T22:46:45.206 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61543.log.gz 2024-09-14T22:46:45.206 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47238.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47238.log.gz 2024-09-14T22:46:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81142.log 2024-09-14T22:46:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40689.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40689.log.gz 2024-09-14T22:46:45.207 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142636.log 2024-09-14T22:46:45.208 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81142.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81142.log.gz 2024-09-14T22:46:45.208 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67595.log 2024-09-14T22:46:45.209 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142636.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142636.log.gz 2024-09-14T22:46:45.209 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53792.log 2024-09-14T22:46:45.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67595.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67595.log.gz 2024-09-14T22:46:45.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125641.log 2024-09-14T22:46:45.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53792.log.gz 2024-09-14T22:46:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46518.log 2024-09-14T22:46:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125641.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125641.log.gz 2024-09-14T22:46:45.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109215.log 2024-09-14T22:46:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46518.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46518.log.gz 2024-09-14T22:46:45.212 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84247.log 2024-09-14T22:46:45.213 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109215.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109215.log.gz 2024-09-14T22:46:45.213 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67699.log 2024-09-14T22:46:45.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84247.log.gz 2024-09-14T22:46:45.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142278.log 2024-09-14T22:46:45.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67699.log.gz 2024-09-14T22:46:45.215 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73781.log 2024-09-14T22:46:45.215 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142278.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142278.log.gz 2024-09-14T22:46:45.215 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55650.log 2024-09-14T22:46:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73781.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73781.log.gz 2024-09-14T22:46:45.216 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123581.log 2024-09-14T22:46:45.217 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55650.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55650.log.gz 2024-09-14T22:46:45.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116360.log 2024-09-14T22:46:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123581.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123581.log.gz 2024-09-14T22:46:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93515.log 2024-09-14T22:46:45.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116360.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116360.log.gz 2024-09-14T22:46:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.83393.log 2024-09-14T22:46:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93515.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93515.log.gz 2024-09-14T22:46:45.219 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61314.log 2024-09-14T22:46:45.220 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56000.log 2024-09-14T22:46:45.220 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.83393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.83393.log.gz 2024-09-14T22:46:45.221 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61314.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61314.log.gz 2024-09-14T22:46:45.221 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111944.log 2024-09-14T22:46:45.222 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56000.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99690.log 2024-09-14T22:46:45.222 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56000.log.gz 2024-09-14T22:46:45.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111944.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36812.log 2024-09-14T22:46:45.223 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111944.log.gz 2024-09-14T22:46:45.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99690.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99690.log.gz 2024-09-14T22:46:45.223 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98996.log 2024-09-14T22:46:45.224 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36812.log.gz 2024-09-14T22:46:45.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107973.log 2024-09-14T22:46:45.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98996.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98996.log.gz 2024-09-14T22:46:45.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145323.log 2024-09-14T22:46:45.226 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107973.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107973.log.gzgzip 2024-09-14T22:46:45.226 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136706.log 2024-09-14T22:46:45.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145323.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145323.log.gz 2024-09-14T22:46:45.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60334.log 2024-09-14T22:46:45.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136706.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136706.log.gz 2024-09-14T22:46:45.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.70393.log 2024-09-14T22:46:45.228 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60334.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60334.log.gz 2024-09-14T22:46:45.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134472.log 2024-09-14T22:46:45.229 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70393.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111211.log 2024-09-14T22:46:45.229 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70393.log.gz 2024-09-14T22:46:45.230 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134472.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster2-client.mirror.129721.log -- replaced with /var/log/ceph/cluster1-client.mirror.134472.log.gz 2024-09-14T22:46:45.230 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111211.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.72360.log 2024-09-14T22:46:45.231 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111211.log.gz 2024-09-14T22:46:45.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129721.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129721.log.gz 2024-09-14T22:46:45.232 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135826.log 2024-09-14T22:46:45.232 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.72360.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.72360.log.gz -5 2024-09-14T22:46:45.232 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.98094.log 2024-09-14T22:46:45.233 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135826.log.gz 2024-09-14T22:46:45.233 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81864.log 2024-09-14T22:46:45.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98094.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128187.log 2024-09-14T22:46:45.234 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98094.log.gz 2024-09-14T22:46:45.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81864.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81864.log.gz 2024-09-14T22:46:45.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121247.log 2024-09-14T22:46:45.236 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128187.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128187.log.gz 2024-09-14T22:46:45.236 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94099.log 2024-09-14T22:46:45.236 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121247.log.gz 2024-09-14T22:46:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37682.log 2024-09-14T22:46:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94099.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94099.log.gz 2024-09-14T22:46:45.237 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123306.log 2024-09-14T22:46:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37682.log.gz 2024-09-14T22:46:45.238 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53834.log 2024-09-14T22:46:45.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123306.log.gz 2024-09-14T22:46:45.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44895.log 2024-09-14T22:46:45.240 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53834.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53834.log.gz 2024-09-14T22:46:45.240 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45401.log 2024-09-14T22:46:45.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44895.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53329.log 2024-09-14T22:46:45.241 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44895.log.gz 2024-09-14T22:46:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45401.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45401.log.gz 2024-09-14T22:46:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146861.log 2024-09-14T22:46:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53329.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.53329.log.gz -- 2024-09-14T22:46:45.242 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.82705.log 2024-09-14T22:46:45.243 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146861.log.gz 2024-09-14T22:46:45.243 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68344.log 2024-09-14T22:46:45.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82705.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115418.log 2024-09-14T22:46:45.244 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82705.log.gz 2024-09-14T22:46:45.245 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68344.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43877.log 2024-09-14T22:46:45.245 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68344.log.gz 2024-09-14T22:46:45.246 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115418.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55803.log 2024-09-14T22:46:45.246 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115418.log.gz 2024-09-14T22:46:45.246 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43877.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146585.log 2024-09-14T22:46:45.246 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43877.log.gz 2024-09-14T22:46:45.247 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55803.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55803.log.gz 2024-09-14T22:46:45.247 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35272.log 2024-09-14T22:46:45.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146585.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146585.log.gz 2024-09-14T22:46:45.248 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36284.log 2024-09-14T22:46:45.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35272.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75022.log 2024-09-14T22:46:45.248 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35272.log.gz 2024-09-14T22:46:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36284.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36284.log.gz 2024-09-14T22:46:45.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132228.log 2024-09-14T22:46:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75022.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75022.log.gz 2024-09-14T22:46:45.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82000.log 2024-09-14T22:46:45.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132228.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132228.log.gz 2024-09-14T22:46:45.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55802.log 2024-09-14T22:46:45.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82000.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.mirror.82000.log.gz -5 2024-09-14T22:46:45.252 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.144925.log 2024-09-14T22:46:45.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55802.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55802.log.gz 2024-09-14T22:46:45.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131568.log 2024-09-14T22:46:45.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144925.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144925.log.gz 2024-09-14T22:46:45.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43595.log 2024-09-14T22:46:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135111.log 2024-09-14T22:46:45.254 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131568.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131568.log.gz 2024-09-14T22:46:45.255 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43595.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80500.log 2024-09-14T22:46:45.255 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43595.log.gz 2024-09-14T22:46:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135111.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135111.log.gz 2024-09-14T22:46:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.36610.log 2024-09-14T22:46:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80500.log.gz 2024-09-14T22:46:45.256 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45990.log 2024-09-14T22:46:45.257 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.36610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.36610.log.gz 2024-09-14T22:46:45.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76493.log 2024-09-14T22:46:45.258 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45990.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45990.log.gz 2024-09-14T22:46:45.258 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110810.log 2024-09-14T22:46:45.259 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76493.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.76493.log.gz -- 2024-09-14T22:46:45.259 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.114484.log 2024-09-14T22:46:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110810.log.gz 2024-09-14T22:46:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124911.log 2024-09-14T22:46:45.260 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114484.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114484.log.gz 2024-09-14T22:46:45.261 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145093.log 2024-09-14T22:46:45.261 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124911.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124911.log.gz 2024-09-14T22:46:45.261 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117928.log 2024-09-14T22:46:45.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145093.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145093.log.gz 2024-09-14T22:46:45.262 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146230.log 2024-09-14T22:46:45.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117928.log.gz 2024-09-14T22:46:45.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76283.log 2024-09-14T22:46:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146230.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146230.log.gz 2024-09-14T22:46:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149272.log 2024-09-14T22:46:45.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76283.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76283.log.gz 2024-09-14T22:46:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138924.log 2024-09-14T22:46:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149272.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149272.log.gz 2024-09-14T22:46:45.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148431.log 2024-09-14T22:46:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138924.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138924.log.gz 2024-09-14T22:46:45.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38797.log 2024-09-14T22:46:45.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148431.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148431.log.gz 2024-09-14T22:46:45.267 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46081.log 2024-09-14T22:46:45.268 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38797.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38797.log.gz 2024-09-14T22:46:45.268 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49467.log 2024-09-14T22:46:45.269 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46081.log.gz 2024-09-14T22:46:45.269 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116424.log 2024-09-14T22:46:45.269 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49467.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49467.log.gz 2024-09-14T22:46:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82798.log 2024-09-14T22:46:45.270 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116424.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.mirror.116424.log.gz --verbose 2024-09-14T22:46:45.270 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.146122.log 2024-09-14T22:46:45.271 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82798.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82798.log.gz 2024-09-14T22:46:45.271 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63517.log 2024-09-14T22:46:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146122.log.gz 2024-09-14T22:46:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102822.log 2024-09-14T22:46:45.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63517.log.gz 2024-09-14T22:46:45.273 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116017.log 2024-09-14T22:46:45.273 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102822.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88924.log 2024-09-14T22:46:45.273 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102822.log.gz 2024-09-14T22:46:45.274 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116017.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116017.log.gz 2024-09-14T22:46:45.274 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148411.log 2024-09-14T22:46:45.275 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88924.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88924.log.gz 2024-09-14T22:46:45.275 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107471.log 2024-09-14T22:46:45.275 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148411.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148411.log.gz 2024-09-14T22:46:45.276 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125007.log 2024-09-14T22:46:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107471.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107471.log.gz 2024-09-14T22:46:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146982.log 2024-09-14T22:46:45.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125007.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125007.log.gz 2024-09-14T22:46:45.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96037.log 2024-09-14T22:46:45.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146982.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146982.log.gz 2024-09-14T22:46:45.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117543.log 2024-09-14T22:46:45.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96037.log.gz 2024-09-14T22:46:45.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123873.log 2024-09-14T22:46:45.280 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117543.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117543.log.gz 2024-09-14T22:46:45.280 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66815.log 2024-09-14T22:46:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123873.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123873.log.gz 2024-09-14T22:46:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39134.log 2024-09-14T22:46:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66815.log.gz 2024-09-14T22:46:45.281 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124107.log 2024-09-14T22:46:45.282 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39134.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39134.log.gzgzip 2024-09-14T22:46:45.282 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.56022.log 2024-09-14T22:46:45.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124107.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78664.log 2024-09-14T22:46:45.283 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124107.log.gz 2024-09-14T22:46:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56022.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56022.log.gz 2024-09-14T22:46:45.284 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35397.log 2024-09-14T22:46:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78664.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78664.log.gz 2024-09-14T22:46:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79540.log 2024-09-14T22:46:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35397.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35397.log.gz 2024-09-14T22:46:45.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53795.log 2024-09-14T22:46:45.286 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79540.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124316.log 2024-09-14T22:46:45.286 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79540.log.gz 2024-09-14T22:46:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53795.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53795.log.gz 2024-09-14T22:46:45.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64250.log 2024-09-14T22:46:45.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124316.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89952.log 2024-09-14T22:46:45.288 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124316.log.gz 2024-09-14T22:46:45.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64250.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64250.log.gz 2024-09-14T22:46:45.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88906.log 2024-09-14T22:46:45.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89952.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.89952.log.gz -5 2024-09-14T22:46:45.290 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.146839.log 2024-09-14T22:46:45.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88906.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88906.log.gz 2024-09-14T22:46:45.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94649.log 2024-09-14T22:46:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146839.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146839.log.gz 2024-09-14T22:46:45.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47596.log 2024-09-14T22:46:45.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94649.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94649.log.gz 2024-09-14T22:46:45.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140158.log 2024-09-14T22:46:45.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47596.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47596.log.gz 2024-09-14T22:46:45.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135913.log 2024-09-14T22:46:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140158.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140158.log.gz 2024-09-14T22:46:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144970.log 2024-09-14T22:46:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135913.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135913.log.gz 2024-09-14T22:46:45.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90669.log 2024-09-14T22:46:45.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144970.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144970.log.gz 2024-09-14T22:46:45.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98072.log 2024-09-14T22:46:45.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90669.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90669.log.gz 2024-09-14T22:46:45.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46108.log 2024-09-14T22:46:45.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98072.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98072.log.gz 2024-09-14T22:46:45.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102869.log 2024-09-14T22:46:45.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46108.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46108.log.gz 2024-09-14T22:46:45.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136748.log 2024-09-14T22:46:45.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102869.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.102869.log.gz --verbose 2024-09-14T22:46:45.298 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.admin.69978.log 2024-09-14T22:46:45.299 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136748.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136748.log.gz 2024-09-14T22:46:45.299 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89575.log 2024-09-14T22:46:45.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.69978.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62068.log 2024-09-14T22:46:45.300 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.69978.log.gz 2024-09-14T22:46:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89575.log.gz 2024-09-14T22:46:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.154210.log 2024-09-14T22:46:45.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62068.log.gz 2024-09-14T22:46:45.302 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88188.log 2024-09-14T22:46:45.302 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.154210.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.154210.log.gz 2024-09-14T22:46:45.303 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45951.log 2024-09-14T22:46:45.303 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88188.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88188.log.gz 2024-09-14T22:46:45.303 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42792.log 2024-09-14T22:46:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45951.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45951.log.gz 2024-09-14T22:46:45.304 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35255.log 2024-09-14T22:46:45.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42792.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42456.log 2024-09-14T22:46:45.305 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42792.log.gz 2024-09-14T22:46:45.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35255.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35255.log.gz 2024-09-14T22:46:45.306 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56198.log 2024-09-14T22:46:45.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42456.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.89198.log -- replaced with /var/log/ceph/cluster1-client.mirror.42456.log.gz 2024-09-14T22:46:45.306 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56198.log.gz 2024-09-14T22:46:45.307 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63097.log 2024-09-14T22:46:45.308 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89198.log.gz 2024-09-14T22:46:45.308 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115082.log 2024-09-14T22:46:45.309 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63097.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63097.log.gz 2024-09-14T22:46:45.309 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144801.log 2024-09-14T22:46:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88776.log 2024-09-14T22:46:45.310 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115082.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115082.log.gz 2024-09-14T22:46:45.311 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144801.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73588.log 2024-09-14T22:46:45.311 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144801.log.gz 2024-09-14T22:46:45.312 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88776.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38018.log 2024-09-14T22:46:45.312 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88776.log.gz 2024-09-14T22:46:45.312 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73588.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73588.log.gz 2024-09-14T22:46:45.312 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47594.log 2024-09-14T22:46:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38018.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38018.log.gz 2024-09-14T22:46:45.313 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91506.log 2024-09-14T22:46:45.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47594.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47594.log.gz 2024-09-14T22:46:45.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106525.log 2024-09-14T22:46:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91506.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.admin.91506.log.gz /var/log/ceph/cluster2-client.admin.128455.log 2024-09-14T22:46:45.315 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106525.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106525.log.gz 2024-09-14T22:46:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52405.log 2024-09-14T22:46:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128455.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128455.log.gz 2024-09-14T22:46:45.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54901.log 2024-09-14T22:46:45.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52405.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.52405.log.gz /var/log/ceph/cluster1-client.mirror.65933.log 2024-09-14T22:46:45.317 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54901.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54901.log.gz 2024-09-14T22:46:45.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65871.log 2024-09-14T22:46:45.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65933.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65933.log.gz 2024-09-14T22:46:45.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80051.log 2024-09-14T22:46:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65871.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65871.log.gz 2024-09-14T22:46:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.119423.log 2024-09-14T22:46:45.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80051.log.gz 2024-09-14T22:46:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46248.log 2024-09-14T22:46:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.119423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.119423.log.gz 2024-09-14T22:46:45.321 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56963.log 2024-09-14T22:46:45.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46248.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46248.log.gz 2024-09-14T22:46:45.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86252.log 2024-09-14T22:46:45.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56963.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56963.log.gz 2024-09-14T22:46:45.323 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130104.log 2024-09-14T22:46:45.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86252.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86252.log.gz 2024-09-14T22:46:45.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112534.log 2024-09-14T22:46:45.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130104.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130104.log.gz 2024-09-14T22:46:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66186.log 2024-09-14T22:46:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112534.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112534.log.gz 2024-09-14T22:46:45.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76783.log 2024-09-14T22:46:45.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66186.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66186.log.gz 2024-09-14T22:46:45.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86762.log 2024-09-14T22:46:45.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76783.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76783.log.gz 2024-09-14T22:46:45.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51064.log 2024-09-14T22:46:45.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86762.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86762.log.gz 2024-09-14T22:46:45.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115858.log 2024-09-14T22:46:45.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51064.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51064.log.gz 2024-09-14T22:46:45.329 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140871.log 2024-09-14T22:46:45.329 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115858.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115858.log.gz 2024-09-14T22:46:45.329 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.117995.log 2024-09-14T22:46:45.330 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140871.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140871.log.gz 2024-09-14T22:46:45.330 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101673.log 2024-09-14T22:46:45.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.117995.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.117995.log.gz 2024-09-14T22:46:45.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36241.log 2024-09-14T22:46:45.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101673.log.gz 2024-09-14T22:46:45.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99467.log 2024-09-14T22:46:45.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36241.log.gz 2024-09-14T22:46:45.332 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87056.log 2024-09-14T22:46:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99467.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99467.log.gz 2024-09-14T22:46:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75191.log 2024-09-14T22:46:45.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87056.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87056.log.gz 2024-09-14T22:46:45.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102251.log 2024-09-14T22:46:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75191.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75191.log.gz 2024-09-14T22:46:45.335 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76451.log 2024-09-14T22:46:45.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102251.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102251.log.gz 2024-09-14T22:46:45.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109550.log 2024-09-14T22:46:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76451.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76451.log.gz 2024-09-14T22:46:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97651.log 2024-09-14T22:46:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109550.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109550.log.gz 2024-09-14T22:46:45.337 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146731.log 2024-09-14T22:46:45.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97651.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97651.log.gz 2024-09-14T22:46:45.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123793.log 2024-09-14T22:46:45.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146731.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146731.log.gz 2024-09-14T22:46:45.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41317.log 2024-09-14T22:46:45.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123793.log.gz 2024-09-14T22:46:45.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148983.log 2024-09-14T22:46:45.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41317.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41317.log.gz 2024-09-14T22:46:45.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126627.log 2024-09-14T22:46:45.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148983.log.gz 2024-09-14T22:46:45.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65977.log 2024-09-14T22:46:45.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126627.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126627.log.gz 2024-09-14T22:46:45.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142853.log 2024-09-14T22:46:45.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65977.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65977.log.gz 2024-09-14T22:46:45.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42326.log 2024-09-14T22:46:45.344 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142853.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142853.log.gz 2024-09-14T22:46:45.344 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119117.log 2024-09-14T22:46:45.345 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42326.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42326.log.gz -5 2024-09-14T22:46:45.345 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.137044.log 2024-09-14T22:46:45.345 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119117.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119117.log.gz 2024-09-14T22:46:45.345 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126016.log 2024-09-14T22:46:45.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137044.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137044.log.gz 2024-09-14T22:46:45.346 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134839.log 2024-09-14T22:46:45.347 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126016.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49760.log 2024-09-14T22:46:45.347 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126016.log.gz 2024-09-14T22:46:45.348 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134839.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134839.log.gz 2024-09-14T22:46:45.348 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108085.log 2024-09-14T22:46:45.349 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49760.log.gz 2024-09-14T22:46:45.349 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118430.log 2024-09-14T22:46:45.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108085.log.gz 2024-09-14T22:46:45.350 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94555.log 2024-09-14T22:46:45.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118430.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118430.log.gz 2024-09-14T22:46:45.351 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56626.log 2024-09-14T22:46:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94555.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94555.log.gz 2024-09-14T22:46:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51567.log 2024-09-14T22:46:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56626.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56626.log.gz 2024-09-14T22:46:45.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128068.log 2024-09-14T22:46:45.353 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51567.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117429.log 2024-09-14T22:46:45.353 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51567.log.gz 2024-09-14T22:46:45.354 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128068.log.gz 2024-09-14T22:46:45.354 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144510.log 2024-09-14T22:46:45.355 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117429.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117429.log.gz 2024-09-14T22:46:45.355 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153087.log 2024-09-14T22:46:45.356 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144510.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144510.log.gz 2024-09-14T22:46:45.356 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128424.log 2024-09-14T22:46:45.356 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153087.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153087.log.gz 2024-09-14T22:46:45.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122638.log 2024-09-14T22:46:45.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128424.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128424.log.gz 2024-09-14T22:46:45.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78875.log 2024-09-14T22:46:45.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122638.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122638.log.gz 2024-09-14T22:46:45.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98180.log 2024-09-14T22:46:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78875.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78875.log.gzgzip 2024-09-14T22:46:45.359 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135422.log 2024-09-14T22:46:45.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98180.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98180.log.gz 2024-09-14T22:46:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108903.log 2024-09-14T22:46:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135422.log.gz 2024-09-14T22:46:45.360 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80484.log 2024-09-14T22:46:45.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108903.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143241.log 2024-09-14T22:46:45.361 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108903.log.gz 2024-09-14T22:46:45.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80484.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80484.log.gz 2024-09-14T22:46:45.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44332.log 2024-09-14T22:46:45.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143241.log.gz 2024-09-14T22:46:45.363 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-osd.1.log 2024-09-14T22:46:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.47181.log 2024-09-14T22:46:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44332.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44332.log.gz 2024-09-14T22:46:45.364 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68441.log 2024-09-14T22:46:45.365 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.47181.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.47181.log.gz 2024-09-14T22:46:45.365 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51167.log 2024-09-14T22:46:45.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68441.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68441.log.gz 2024-09-14T22:46:45.366 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123372.log 2024-09-14T22:46:45.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51167.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66662.log 2024-09-14T22:46:45.367 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51167.log.gz 2024-09-14T22:46:45.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123372.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123372.log.gz 2024-09-14T22:46:45.368 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56772.log 2024-09-14T22:46:45.368 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66662.log.gzgzip 2024-09-14T22:46:45.368 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74856.log 2024-09-14T22:46:45.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56772.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56772.log.gz 2024-09-14T22:46:45.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75566.log 2024-09-14T22:46:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74856.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.74856.log.gz /var/log/ceph/cluster1-client.mirror.133757.log 2024-09-14T22:46:45.370 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75566.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75566.log.gz 2024-09-14T22:46:45.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123024.log 2024-09-14T22:46:45.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133757.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39704.log 2024-09-14T22:46:45.371 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133757.log.gz 2024-09-14T22:46:45.372 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123024.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123024.log.gz 2024-09-14T22:46:45.372 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104850.log 2024-09-14T22:46:45.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39704.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.96122.log 2024-09-14T22:46:45.373 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39704.log.gz 2024-09-14T22:46:45.374 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104850.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104850.log.gz 2024-09-14T22:46:45.374 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94254.log 2024-09-14T22:46:45.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.96122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.96122.log.gz 2024-09-14T22:46:45.375 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118726.log 2024-09-14T22:46:45.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94254.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.admin.94254.log.gz -- 2024-09-14T22:46:45.375 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.92100.log 2024-09-14T22:46:45.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118726.log.gz 2024-09-14T22:46:45.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114006.log 2024-09-14T22:46:45.377 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92100.log.gz 2024-09-14T22:46:45.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145221.log 2024-09-14T22:46:45.378 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114006.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.114006.log.gz /var/log/ceph/cluster1-client.mirror.131216.log 2024-09-14T22:46:45.378 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145221.log.gz 2024-09-14T22:46:45.379 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98809.log 2024-09-14T22:46:45.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131216.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.134780.log 2024-09-14T22:46:45.379 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.131216.log.gz 2024-09-14T22:46:45.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98809.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98809.log.gz 2024-09-14T22:46:45.380 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137259.log 2024-09-14T22:46:45.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134780.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134780.log.gz 2024-09-14T22:46:45.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.78950.log 2024-09-14T22:46:45.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137259.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137259.log.gz 2024-09-14T22:46:45.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136838.log 2024-09-14T22:46:45.383 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.78950.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62552.log 2024-09-14T22:46:45.383 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.78950.log.gz 2024-09-14T22:46:45.383 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136838.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136838.log.gz 2024-09-14T22:46:45.383 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115572.log 2024-09-14T22:46:45.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62552.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62552.log.gz 2024-09-14T22:46:45.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39935.log 2024-09-14T22:46:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115572.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135009.log 2024-09-14T22:46:45.385 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115572.log.gz 2024-09-14T22:46:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39935.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39935.log.gz 2024-09-14T22:46:45.385 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135700.log 2024-09-14T22:46:45.386 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135009.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69388.log 2024-09-14T22:46:45.386 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135009.log.gz 2024-09-14T22:46:45.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135700.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135700.log.gz 2024-09-14T22:46:45.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96440.log 2024-09-14T22:46:45.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69388.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124420.log 2024-09-14T22:46:45.388 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69388.log.gz 2024-09-14T22:46:45.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96440.log.gz 2024-09-14T22:46:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40776.log 2024-09-14T22:46:45.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124420.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.38591.log 2024-09-14T22:46:45.389 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.124420.log.gz 2024-09-14T22:46:45.390 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40776.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.40776.log.gz /var/log/ceph/cluster1-client.mirror.90124.log 2024-09-14T22:46:45.390 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38591.log.gz 2024-09-14T22:46:45.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129876.log 2024-09-14T22:46:45.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90124.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94213.log 2024-09-14T22:46:45.392 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90124.log.gz 2024-09-14T22:46:45.392 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129876.log.gz 2024-09-14T22:46:45.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90783.log 2024-09-14T22:46:45.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94213.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73716.log 2024-09-14T22:46:45.393 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94213.log.gz 2024-09-14T22:46:45.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90783.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.81469.log 2024-09-14T22:46:45.394 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90783.log.gz 2024-09-14T22:46:45.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73716.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55978.log 2024-09-14T22:46:45.395 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73716.log.gz 2024-09-14T22:46:45.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.81469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.81469.log.gz 2024-09-14T22:46:45.395 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51271.log 2024-09-14T22:46:45.396 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55978.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55978.log.gz 2024-09-14T22:46:45.396 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.128565.log 2024-09-14T22:46:45.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51271.log.gz 2024-09-14T22:46:45.397 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107168.log 2024-09-14T22:46:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.128565.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.128565.log.gz 2024-09-14T22:46:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112748.log 2024-09-14T22:46:45.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107168.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107168.log.gz -5 2024-09-14T22:46:45.399 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.66080.log 2024-09-14T22:46:45.399 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112748.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112748.log.gz 2024-09-14T22:46:45.399 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52256.log 2024-09-14T22:46:45.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66080.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.116438.log 2024-09-14T22:46:45.400 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66080.log.gz 2024-09-14T22:46:45.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52256.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52256.log.gz 2024-09-14T22:46:45.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42115.log 2024-09-14T22:46:45.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.116438.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.148141.log -- replaced with /var/log/ceph/cluster2-client.mirror.116438.log.gz 2024-09-14T22:46:45.402 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.402 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42115.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42115.log.gz 2024-09-14T22:46:45.402 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139131.log 2024-09-14T22:46:45.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148141.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.148141.log.gz 2024-09-14T22:46:45.403 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster2-client.admin.128846.log 2024-09-14T22:46:45.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139131.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139131.log.gz 2024-09-14T22:46:45.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111066.log 2024-09-14T22:46:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128846.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128846.log.gz 2024-09-14T22:46:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64419.log 2024-09-14T22:46:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111066.log.gz 2024-09-14T22:46:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125469.log 2024-09-14T22:46:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64419.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64419.log.gz 2024-09-14T22:46:45.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114547.log 2024-09-14T22:46:45.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125469.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77294.log 2024-09-14T22:46:45.407 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125469.log.gz 2024-09-14T22:46:45.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114547.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84707.log 2024-09-14T22:46:45.408 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114547.log.gz 2024-09-14T22:46:45.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77294.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77294.log.gz 2024-09-14T22:46:45.409 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121984.log 2024-09-14T22:46:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84707.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84707.log.gz 2024-09-14T22:46:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52996.log 2024-09-14T22:46:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121984.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121984.log.gz 2024-09-14T22:46:45.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43811.log 2024-09-14T22:46:45.411 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52996.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52996.log.gz 2024-09-14T22:46:45.411 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125429.log 2024-09-14T22:46:45.412 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85287.log 2024-09-14T22:46:45.412 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43811.log.gz 2024-09-14T22:46:45.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125429.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.125429.log.gz 2024-09-14T22:46:45.413 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster2-client.mirror.46154.log 2024-09-14T22:46:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85287.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.85287.log.gz -5 2024-09-14T22:46:45.414 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.75523.log 2024-09-14T22:46:45.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46154.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46154.log.gz 2024-09-14T22:46:45.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83723.log 2024-09-14T22:46:45.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75523.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.75523.log.gz 2024-09-14T22:46:45.415 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.125239.log 2024-09-14T22:46:45.416 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83723.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83723.log.gz 2024-09-14T22:46:45.416 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127568.log 2024-09-14T22:46:45.417 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125239.log.gz 2024-09-14T22:46:45.417 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100655.log 2024-09-14T22:46:45.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127568.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127568.log.gz 2024-09-14T22:46:45.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101204.log 2024-09-14T22:46:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100655.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100655.log.gz 2024-09-14T22:46:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53707.log 2024-09-14T22:46:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101204.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101204.log.gz 2024-09-14T22:46:45.419 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65301.log 2024-09-14T22:46:45.420 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53707.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53707.log.gz 2024-09-14T22:46:45.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138238.log 2024-09-14T22:46:45.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65301.log.gz 2024-09-14T22:46:45.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67787.log 2024-09-14T22:46:45.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138238.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138238.log.gz 2024-09-14T22:46:45.422 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148769.log 2024-09-14T22:46:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67787.log.gz 2024-09-14T22:46:45.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70756.log 2024-09-14T22:46:45.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148769.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49339.log 2024-09-14T22:46:45.424 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148769.log.gz 2024-09-14T22:46:45.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70756.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.70756.log.gz -5 2024-09-14T22:46:45.425 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.128607.log 2024-09-14T22:46:45.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49339.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49339.log.gz 2024-09-14T22:46:45.425 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90328.log 2024-09-14T22:46:45.426 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128607.log.gz 2024-09-14T22:46:45.426 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115155.log 2024-09-14T22:46:45.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130473.log 2024-09-14T22:46:45.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90328.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90328.log.gz 2024-09-14T22:46:45.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115155.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115155.log.gz 2024-09-14T22:46:45.428 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137216.log 2024-09-14T22:46:45.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130473.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73505.log 2024-09-14T22:46:45.429 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130473.log.gz 2024-09-14T22:46:45.429 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137216.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137216.log.gz 2024-09-14T22:46:45.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129183.log 2024-09-14T22:46:45.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73505.log.gz 2024-09-14T22:46:45.430 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66017.log 2024-09-14T22:46:45.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129183.log.gz 2024-09-14T22:46:45.431 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78425.log 2024-09-14T22:46:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66017.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66017.log.gz 2024-09-14T22:46:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75276.log 2024-09-14T22:46:45.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78425.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78425.log.gz 2024-09-14T22:46:45.433 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66675.log 2024-09-14T22:46:45.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75276.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75276.log.gz 2024-09-14T22:46:45.434 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113373.log 2024-09-14T22:46:45.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66675.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66675.log.gz 2024-09-14T22:46:45.435 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65661.log 2024-09-14T22:46:45.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113373.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54381.log 2024-09-14T22:46:45.435 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113373.log.gz 2024-09-14T22:46:45.436 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65661.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65661.log.gz 2024-09-14T22:46:45.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130820.log 2024-09-14T22:46:45.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54381.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54381.log.gz 2024-09-14T22:46:45.437 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38129.log 2024-09-14T22:46:45.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130820.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130820.log.gz 2024-09-14T22:46:45.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64211.log 2024-09-14T22:46:45.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38129.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38129.log.gz 2024-09-14T22:46:45.439 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61943.log 2024-09-14T22:46:45.439 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64211.log.gz 2024-09-14T22:46:45.439 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69953.log 2024-09-14T22:46:45.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61943.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61943.log.gz 2024-09-14T22:46:45.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85730.log 2024-09-14T22:46:45.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69953.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69953.log.gz 2024-09-14T22:46:45.441 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36546.log 2024-09-14T22:46:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85730.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85730.log.gz 2024-09-14T22:46:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114319.log 2024-09-14T22:46:45.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36546.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36546.log.gz 2024-09-14T22:46:45.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131986.log 2024-09-14T22:46:45.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114319.log.gz 2024-09-14T22:46:45.444 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103704.log 2024-09-14T22:46:45.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131986.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56349.log 2024-09-14T22:46:45.445 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131986.log.gz 2024-09-14T22:46:45.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103704.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103704.log.gz 2024-09-14T22:46:45.445 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76578.log 2024-09-14T22:46:45.446 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56349.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56349.log.gz 2024-09-14T22:46:45.446 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147233.log 2024-09-14T22:46:45.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76578.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76578.log.gz 2024-09-14T22:46:45.447 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39554.log 2024-09-14T22:46:45.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147233.log.gz 2024-09-14T22:46:45.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104930.log 2024-09-14T22:46:45.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39554.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39554.log.gz 2024-09-14T22:46:45.449 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59395.log 2024-09-14T22:46:45.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104930.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104930.log.gz 2024-09-14T22:46:45.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61149.log 2024-09-14T22:46:45.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59395.log.gz 2024-09-14T22:46:45.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85395.log 2024-09-14T22:46:45.451 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61149.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61149.log.gz 2024-09-14T22:46:45.452 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111558.log 2024-09-14T22:46:45.452 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85395.log.gz 2024-09-14T22:46:45.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105353.log 2024-09-14T22:46:45.453 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111558.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111558.log.gz 2024-09-14T22:46:45.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47202.log 2024-09-14T22:46:45.454 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105353.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105353.log.gz 2024-09-14T22:46:45.454 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41928.log 2024-09-14T22:46:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47202.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120533.log 2024-09-14T22:46:45.455 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47202.log.gz 2024-09-14T22:46:45.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41928.log.gz 2024-09-14T22:46:45.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110119.log 2024-09-14T22:46:45.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120533.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120533.log.gz 2024-09-14T22:46:45.456 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131047.log 2024-09-14T22:46:45.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110119.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110119.log.gz 2024-09-14T22:46:45.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.153298.log 2024-09-14T22:46:45.458 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131047.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.131047.log.gz --verbose 2024-09-14T22:46:45.458 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.75145.log 2024-09-14T22:46:45.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153298.log.gz 2024-09-14T22:46:45.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102405.log 2024-09-14T22:46:45.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75145.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75145.log.gz 2024-09-14T22:46:45.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108967.log 2024-09-14T22:46:45.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102405.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102405.log.gz 2024-09-14T22:46:45.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65369.log 2024-09-14T22:46:45.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108967.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108967.log.gz 2024-09-14T22:46:45.461 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102688.log 2024-09-14T22:46:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65369.log.gz 2024-09-14T22:46:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126935.log 2024-09-14T22:46:45.462 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102688.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102688.log.gz 2024-09-14T22:46:45.463 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95862.log 2024-09-14T22:46:45.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126935.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126935.log.gz 2024-09-14T22:46:45.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82269.log 2024-09-14T22:46:45.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95862.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95862.log.gz 2024-09-14T22:46:45.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142985.log 2024-09-14T22:46:45.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82269.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82269.log.gz 2024-09-14T22:46:45.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65870.log 2024-09-14T22:46:45.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142985.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142985.log.gz 2024-09-14T22:46:45.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132750.log 2024-09-14T22:46:45.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65870.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50896.log 2024-09-14T22:46:45.467 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65870.log.gz 2024-09-14T22:46:45.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132750.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132750.log.gz 2024-09-14T22:46:45.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43593.log 2024-09-14T22:46:45.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50896.log.gz 2024-09-14T22:46:45.469 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97376.log 2024-09-14T22:46:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43593.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43593.log.gz 2024-09-14T22:46:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76743.log 2024-09-14T22:46:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97376.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97376.log.gz 2024-09-14T22:46:45.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51776.log 2024-09-14T22:46:45.471 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76743.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76743.log.gz 2024-09-14T22:46:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141801.log 2024-09-14T22:46:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51776.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51776.log.gz 2024-09-14T22:46:45.472 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74549.log 2024-09-14T22:46:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141801.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141801.log.gz 2024-09-14T22:46:45.473 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115880.log 2024-09-14T22:46:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74549.log.gz 2024-09-14T22:46:45.474 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111779.log 2024-09-14T22:46:45.475 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115880.log.gz 2024-09-14T22:46:45.475 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57243.log 2024-09-14T22:46:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111779.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111779.log.gz 2024-09-14T22:46:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37870.log 2024-09-14T22:46:45.476 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57243.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57243.log.gz 2024-09-14T22:46:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47916.log 2024-09-14T22:46:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37870.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37870.log.gz 2024-09-14T22:46:45.477 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117569.log 2024-09-14T22:46:45.478 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47916.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105619.log 2024-09-14T22:46:45.478 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47916.log.gz 2024-09-14T22:46:45.479 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117569.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.117569.log.gz 2024-09-14T22:46:45.479 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119796.log 2024-09-14T22:46:45.479 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105619.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105619.log.gz 2024-09-14T22:46:45.480 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58677.log 2024-09-14T22:46:45.480 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119796.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119796.log.gz 2024-09-14T22:46:45.481 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133632.log 2024-09-14T22:46:45.481 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58677.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58677.log.gz 2024-09-14T22:46:45.482 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118921.log 2024-09-14T22:46:45.482 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133632.log: gzip -5 --verbose 0.0% -- /var/log/ceph/cluster1-client.mirror.84917.log -- replaced with /var/log/ceph/cluster1-client.mirror.133632.log.gz 2024-09-14T22:46:45.482 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.483 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118921.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118921.log.gz 2024-09-14T22:46:45.483 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66787.log 2024-09-14T22:46:45.484 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84917.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84917.log.gz 2024-09-14T22:46:45.484 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53667.log 2024-09-14T22:46:45.485 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66787.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66787.log.gz 2024-09-14T22:46:45.485 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47500.log 2024-09-14T22:46:45.486 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53667.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53667.log.gz 2024-09-14T22:46:45.486 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144591.log 2024-09-14T22:46:45.487 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47500.log.gz 2024-09-14T22:46:45.487 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52701.log 2024-09-14T22:46:45.488 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144591.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144591.log.gz 2024-09-14T22:46:45.488 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57397.log 2024-09-14T22:46:45.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52701.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98931.log 2024-09-14T22:46:45.489 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52701.log.gz 2024-09-14T22:46:45.489 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57397.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57397.log.gz 2024-09-14T22:46:45.489 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64063.log 2024-09-14T22:46:45.490 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98931.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98931.log.gz 2024-09-14T22:46:45.490 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39997.log 2024-09-14T22:46:45.491 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64063.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64063.log.gz 2024-09-14T22:46:45.491 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110433.log 2024-09-14T22:46:45.492 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39997.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39997.log.gz 2024-09-14T22:46:45.492 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114173.log 2024-09-14T22:46:45.493 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110433.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110433.log.gz 2024-09-14T22:46:45.493 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44676.log 2024-09-14T22:46:45.494 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114173.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114173.log.gz 2024-09-14T22:46:45.494 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.140319.log 2024-09-14T22:46:45.494 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44676.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44676.log.gz 2024-09-14T22:46:45.495 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131084.log 2024-09-14T22:46:45.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140319.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140319.log.gz 2024-09-14T22:46:45.496 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136288.log 2024-09-14T22:46:45.496 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131084.log.gz 2024-09-14T22:46:45.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115463.log 2024-09-14T22:46:45.497 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136288.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136288.log.gz 2024-09-14T22:46:45.498 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55648.log 2024-09-14T22:46:45.498 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115463.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95708.log 2024-09-14T22:46:45.498 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115463.log.gz 2024-09-14T22:46:45.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55648.log.gz 2024-09-14T22:46:45.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82953.log 2024-09-14T22:46:45.500 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95708.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141755.log 2024-09-14T22:46:45.500 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95708.log.gz 2024-09-14T22:46:45.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82953.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.82953.log.gz 2024-09-14T22:46:45.501 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37370.log 2024-09-14T22:46:45.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141755.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141755.log.gz 2024-09-14T22:46:45.502 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110434.log 2024-09-14T22:46:45.502 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37370.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37370.log.gz 2024-09-14T22:46:45.502 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105399.log 2024-09-14T22:46:45.503 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110434.log.gz 2024-09-14T22:46:45.503 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137887.log 2024-09-14T22:46:45.504 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105399.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105399.log.gz 2024-09-14T22:46:45.504 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125890.log 2024-09-14T22:46:45.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137887.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137887.log.gz 2024-09-14T22:46:45.505 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125744.log 2024-09-14T22:46:45.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125890.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125890.log.gz 2024-09-14T22:46:45.506 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52447.log 2024-09-14T22:46:45.507 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125744.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125744.log.gz 2024-09-14T22:46:45.507 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131918.log 2024-09-14T22:46:45.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52447.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52447.log.gz 2024-09-14T22:46:45.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77877.log 2024-09-14T22:46:45.508 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131918.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131918.log.gz 2024-09-14T22:46:45.508 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96100.log 2024-09-14T22:46:45.509 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77877.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77877.log.gz 2024-09-14T22:46:45.509 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145364.log 2024-09-14T22:46:45.510 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96100.log.gz 2024-09-14T22:46:45.510 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109067.log 2024-09-14T22:46:45.511 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145364.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124632.log 2024-09-14T22:46:45.511 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145364.log.gz 2024-09-14T22:46:45.512 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109067.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109067.log.gz 2024-09-14T22:46:45.512 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66481.log 2024-09-14T22:46:45.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124632.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124632.log.gz 2024-09-14T22:46:45.513 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79538.log 2024-09-14T22:46:45.513 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66481.log.gz 2024-09-14T22:46:45.513 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135495.log 2024-09-14T22:46:45.514 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79538.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79538.log.gz 2024-09-14T22:46:45.514 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87453.log 2024-09-14T22:46:45.515 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135495.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135495.log.gz 2024-09-14T22:46:45.515 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148564.log 2024-09-14T22:46:45.516 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87453.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87453.log.gz 2024-09-14T22:46:45.516 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85917.log 2024-09-14T22:46:45.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148564.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148564.log.gz 2024-09-14T22:46:45.517 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82524.log 2024-09-14T22:46:45.517 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85917.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85917.log.gz 2024-09-14T22:46:45.518 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97459.log 2024-09-14T22:46:45.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82524.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82524.log.gz 2024-09-14T22:46:45.519 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126185.log 2024-09-14T22:46:45.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97459.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97459.log.gz 2024-09-14T22:46:45.520 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75321.log 2024-09-14T22:46:45.520 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126185.log.gz 2024-09-14T22:46:45.520 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73909.log 2024-09-14T22:46:45.521 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75321.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84182.log 2024-09-14T22:46:45.521 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75321.log.gz 2024-09-14T22:46:45.522 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73909.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63812.log 2024-09-14T22:46:45.522 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73909.log.gz 2024-09-14T22:46:45.523 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84182.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84182.log.gz 2024-09-14T22:46:45.523 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121311.log 2024-09-14T22:46:45.523 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63812.log.gz 2024-09-14T22:46:45.524 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123579.log 2024-09-14T22:46:45.524 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121311.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121311.log.gz 2024-09-14T22:46:45.525 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70233.log 2024-09-14T22:46:45.525 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123579.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123579.log.gz 2024-09-14T22:46:45.525 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45297.log 2024-09-14T22:46:45.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70233.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70233.log.gz 2024-09-14T22:46:45.526 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113374.log 2024-09-14T22:46:45.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45297.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62707.log 2024-09-14T22:46:45.527 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45297.log.gz 2024-09-14T22:46:45.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113374.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113374.log.gz 2024-09-14T22:46:45.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107739.log 2024-09-14T22:46:45.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62707.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62707.log.gz 2024-09-14T22:46:45.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131746.log 2024-09-14T22:46:45.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107739.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107739.log.gz 2024-09-14T22:46:45.530 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141386.log 2024-09-14T22:46:45.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131746.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131746.log.gz 2024-09-14T22:46:45.530 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149188.log 2024-09-14T22:46:45.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141386.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39515.log 2024-09-14T22:46:45.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141386.log.gz 2024-09-14T22:46:45.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149188.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149188.log.gz 2024-09-14T22:46:45.532 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87810.log 2024-09-14T22:46:45.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39515.log.gz 2024-09-14T22:46:45.533 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140451.log 2024-09-14T22:46:45.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87810.log.gz 2024-09-14T22:46:45.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144854.log 2024-09-14T22:46:45.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140451.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140451.log.gz 2024-09-14T22:46:45.535 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109741.log 2024-09-14T22:46:45.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144854.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144854.log.gz 2024-09-14T22:46:45.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40312.log 2024-09-14T22:46:45.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109741.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109741.log.gz 2024-09-14T22:46:45.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54046.log 2024-09-14T22:46:45.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40312.log.gz 2024-09-14T22:46:45.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90928.log 2024-09-14T22:46:45.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54046.log.gz 2024-09-14T22:46:45.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41169.log 2024-09-14T22:46:45.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90928.log.gz 2024-09-14T22:46:45.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105788.log 2024-09-14T22:46:45.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41169.log.gz 2024-09-14T22:46:45.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49006.log 2024-09-14T22:46:45.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105788.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105788.log.gz 2024-09-14T22:46:45.541 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71576.log 2024-09-14T22:46:45.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49006.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96468.log 2024-09-14T22:46:45.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49006.log.gz 2024-09-14T22:46:45.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71576.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71576.log.gz -5 2024-09-14T22:46:45.542 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.113854.log 2024-09-14T22:46:45.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96468.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96468.log.gz 2024-09-14T22:46:45.543 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149086.log 2024-09-14T22:46:45.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113854.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113854.log.gz 2024-09-14T22:46:45.544 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35360.log 2024-09-14T22:46:45.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149086.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149086.log.gz 2024-09-14T22:46:45.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78948.log 2024-09-14T22:46:45.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35360.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35360.log.gz 2024-09-14T22:46:45.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69443.log 2024-09-14T22:46:45.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78948.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78948.log.gz 2024-09-14T22:46:45.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109025.log 2024-09-14T22:46:45.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69443.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69443.log.gz 2024-09-14T22:46:45.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68842.log 2024-09-14T22:46:45.548 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109025.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109025.log.gz 2024-09-14T22:46:45.548 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76935.log 2024-09-14T22:46:45.549 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68842.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68842.log.gz 2024-09-14T22:46:45.549 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42286.log 2024-09-14T22:46:45.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76935.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70548.log 0.0% 2024-09-14T22:46:45.550 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.76935.log.gz 2024-09-14T22:46:45.550 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42286.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42286.log.gz 2024-09-14T22:46:45.551 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51985.log 2024-09-14T22:46:45.551 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70548.log.gz 2024-09-14T22:46:45.552 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50895.log 2024-09-14T22:46:45.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51985.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51985.log.gz 2024-09-14T22:46:45.553 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48796.log 2024-09-14T22:46:45.553 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50895.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137927.log 2024-09-14T22:46:45.553 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50895.log.gz 2024-09-14T22:46:45.554 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48796.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111824.log 2024-09-14T22:46:45.554 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48796.log.gz 2024-09-14T22:46:45.555 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137927.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.137927.log.gz -5 2024-09-14T22:46:45.555 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.142805.log 2024-09-14T22:46:45.556 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111824.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.111824.log.gz 2024-09-14T22:46:45.556 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.107300.log 2024-09-14T22:46:45.556 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142805.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142805.log.gz 2024-09-14T22:46:45.557 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141254.log 2024-09-14T22:46:45.557 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107300.log.gz 2024-09-14T22:46:45.558 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81814.log 2024-09-14T22:46:45.558 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141254.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.141254.log.gz 2024-09-14T22:46:45.558 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133548.log 2024-09-14T22:46:45.559 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81814.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81814.log.gz 2024-09-14T22:46:45.559 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88822.log 2024-09-14T22:46:45.560 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133548.log.gz 2024-09-14T22:46:45.560 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150941.log 2024-09-14T22:46:45.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88822.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88822.log.gz 2024-09-14T22:46:45.561 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106773.log 2024-09-14T22:46:45.561 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150941.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150941.log.gz 2024-09-14T22:46:45.562 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130613.log 2024-09-14T22:46:45.562 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106773.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106773.log.gz 2024-09-14T22:46:45.563 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74348.log 2024-09-14T22:46:45.563 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130613.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130613.log.gz 2024-09-14T22:46:45.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105737.log 2024-09-14T22:46:45.564 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74348.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74348.log.gz 2024-09-14T22:46:45.564 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148746.log 2024-09-14T22:46:45.565 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105737.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105737.log.gz 2024-09-14T22:46:45.565 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90163.log 2024-09-14T22:46:45.566 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148746.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148746.log.gz 2024-09-14T22:46:45.566 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.142211.log 2024-09-14T22:46:45.566 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90163.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90163.log.gz 2024-09-14T22:46:45.567 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49130.log 2024-09-14T22:46:45.567 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.142211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.142211.log.gz 2024-09-14T22:46:45.568 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49863.log 2024-09-14T22:46:45.568 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49130.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49130.log.gz 2024-09-14T22:46:45.569 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57659.log 2024-09-14T22:46:45.569 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49863.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70890.log 2024-09-14T22:46:45.569 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49863.log.gz 2024-09-14T22:46:45.570 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57659.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57659.log.gz 2024-09-14T22:46:45.570 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116277.log 2024-09-14T22:46:45.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70890.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70890.log.gz 2024-09-14T22:46:45.571 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112071.log 2024-09-14T22:46:45.571 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116277.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154827.log 2024-09-14T22:46:45.572 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116277.log.gz 2024-09-14T22:46:45.572 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112071.log.gz 2024-09-14T22:46:45.572 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116170.log 2024-09-14T22:46:45.573 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154827.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154827.log.gz 2024-09-14T22:46:45.573 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82135.log 2024-09-14T22:46:45.574 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116170.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77712.log 2024-09-14T22:46:45.574 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116170.log.gz 2024-09-14T22:46:45.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82135.log.gz 2024-09-14T22:46:45.575 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42031.log 2024-09-14T22:46:45.575 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77712.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90438.log 2024-09-14T22:46:45.575 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77712.log.gz 2024-09-14T22:46:45.576 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42031.log.gz 2024-09-14T22:46:45.576 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104421.log 2024-09-14T22:46:45.577 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90438.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101032.log 2024-09-14T22:46:45.577 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90438.log.gz 2024-09-14T22:46:45.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104421.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104421.log.gz 2024-09-14T22:46:45.578 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102625.log 2024-09-14T22:46:45.578 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101032.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101032.log.gz 2024-09-14T22:46:45.579 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55002.log 2024-09-14T22:46:45.579 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102625.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119883.log 2024-09-14T22:46:45.579 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102625.log.gz 2024-09-14T22:46:45.580 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55002.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55002.log.gz 2024-09-14T22:46:45.580 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51315.log 2024-09-14T22:46:45.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119883.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119883.log.gz 2024-09-14T22:46:45.581 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106700.log 2024-09-14T22:46:45.581 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51315.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51315.log.gz -5 2024-09-14T22:46:45.581 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.134516.log 2024-09-14T22:46:45.582 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106700.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106700.log.gzgzip 2024-09-14T22:46:45.582 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.151409.log 2024-09-14T22:46:45.583 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134516.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134516.log.gz 2024-09-14T22:46:45.583 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52237.log 2024-09-14T22:46:45.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151409.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151409.log.gz 2024-09-14T22:46:45.584 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73412.log 2024-09-14T22:46:45.584 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52237.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149925.log 2024-09-14T22:46:45.585 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52237.log.gz 2024-09-14T22:46:45.585 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73412.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128002.log 2024-09-14T22:46:45.585 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73412.log.gz 2024-09-14T22:46:45.586 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149925.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149925.log.gz 2024-09-14T22:46:45.586 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36983.log 2024-09-14T22:46:45.587 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128002.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128002.log.gz 2024-09-14T22:46:45.587 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153318.log 2024-09-14T22:46:45.588 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36983.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36983.log.gzgzip 2024-09-14T22:46:45.588 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49529.log 2024-09-14T22:46:45.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153318.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105012.log 2024-09-14T22:46:45.589 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153318.log.gz 2024-09-14T22:46:45.589 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49529.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91793.log 2024-09-14T22:46:45.590 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49529.log.gz 2024-09-14T22:46:45.593 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105012.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105012.log.gz 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83941.log 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91793.log.gz 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133103.log 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83941.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83941.log.gz 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134517.log 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133103.log.gz 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107435.log 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134517.log.gz 2024-09-14T22:46:45.594 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42366.log 2024-09-14T22:46:45.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107435.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.130312.log 2024-09-14T22:46:45.595 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107435.log.gz 2024-09-14T22:46:45.595 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42366.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73655.log 2024-09-14T22:46:45.595 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42366.log.gz 2024-09-14T22:46:45.596 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.130312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.130312.log.gz 2024-09-14T22:46:45.596 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52071.log 2024-09-14T22:46:45.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73655.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118922.log 2024-09-14T22:46:45.597 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73655.log.gz 2024-09-14T22:46:45.597 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52071.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52071.log.gz 2024-09-14T22:46:45.597 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143801.log 2024-09-14T22:46:45.598 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118922.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118922.log.gz 2024-09-14T22:46:45.598 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105147.log 2024-09-14T22:46:45.599 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143801.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149313.log 2024-09-14T22:46:45.599 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143801.log.gz 2024-09-14T22:46:45.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105147.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43088.log 2024-09-14T22:46:45.600 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105147.log.gz 2024-09-14T22:46:45.600 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149313.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149313.log.gz 2024-09-14T22:46:45.600 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132607.log 2024-09-14T22:46:45.601 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43088.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43088.log.gz 2024-09-14T22:46:45.601 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.44825.log 2024-09-14T22:46:45.602 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132607.log.gz 2024-09-14T22:46:45.602 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52867.log 2024-09-14T22:46:45.603 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.44825.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.44825.log.gz 2024-09-14T22:46:45.603 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70984.log 2024-09-14T22:46:45.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52867.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.66678.log 2024-09-14T22:46:45.604 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52867.log.gz 2024-09-14T22:46:45.604 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70984.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.70984.log.gz 2024-09-14T22:46:45.605 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.127799.log 2024-09-14T22:46:45.605 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.66678.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.66678.log.gz 2024-09-14T22:46:45.605 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.141092.log 2024-09-14T22:46:45.606 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127799.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127799.log.gz 2024-09-14T22:46:45.606 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139373.log 2024-09-14T22:46:45.607 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.141092.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.admin.141092.log.gz --verbose 2024-09-14T22:46:45.607 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.42547.log 2024-09-14T22:46:45.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139373.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139373.log.gz 2024-09-14T22:46:45.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93822.log 2024-09-14T22:46:45.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42547.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94938.log 2024-09-14T22:46:45.609 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42547.log.gz 2024-09-14T22:46:45.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93822.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93822.log.gz 2024-09-14T22:46:45.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50348.log 2024-09-14T22:46:45.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94938.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38461.log 2024-09-14T22:46:45.610 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94938.log.gz 2024-09-14T22:46:45.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50348.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50348.log.gz 2024-09-14T22:46:45.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43269.log 2024-09-14T22:46:45.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38461.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75525.log 2024-09-14T22:46:45.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38461.log.gz 2024-09-14T22:46:45.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43269.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64297.log 2024-09-14T22:46:45.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43269.log.gz 2024-09-14T22:46:45.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75525.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75525.log.gz 2024-09-14T22:46:45.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38927.log 2024-09-14T22:46:45.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64297.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64297.log.gz 2024-09-14T22:46:45.614 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41445.log 2024-09-14T22:46:45.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38927.log.gz 2024-09-14T22:46:45.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126143.log 2024-09-14T22:46:45.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41445.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71154.log 2024-09-14T22:46:45.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41445.log.gz 2024-09-14T22:46:45.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126143.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126143.log.gz 2024-09-14T22:46:45.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129675.log 2024-09-14T22:46:45.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71154.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71154.log.gz 2024-09-14T22:46:45.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.141527.log 2024-09-14T22:46:45.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129675.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129675.log.gz 2024-09-14T22:46:45.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99457.log 2024-09-14T22:46:45.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.141527.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.141527.log.gz 2024-09-14T22:46:45.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56883.log 2024-09-14T22:46:45.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99457.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99457.log.gz 2024-09-14T22:46:45.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51439.log 2024-09-14T22:46:45.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56883.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56883.log.gz 2024-09-14T22:46:45.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38168.log 2024-09-14T22:46:45.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51439.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51439.log.gz 2024-09-14T22:46:45.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71660.log 2024-09-14T22:46:45.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38168.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38168.log.gz 2024-09-14T22:46:45.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102646.log 2024-09-14T22:46:45.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71660.log.gz 2024-09-14T22:46:45.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.95011.log 2024-09-14T22:46:45.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102646.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102646.log.gz 2024-09-14T22:46:45.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39490.log 2024-09-14T22:46:45.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.95011.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137637.log 2024-09-14T22:46:45.625 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.95011.log.gz 2024-09-14T22:46:45.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39490.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39490.log.gz 2024-09-14T22:46:45.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37010.log 2024-09-14T22:46:45.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137637.log.gz 2024-09-14T22:46:45.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82664.log 2024-09-14T22:46:45.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37010.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37010.log.gz 2024-09-14T22:46:45.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137084.log 2024-09-14T22:46:45.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82664.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82664.log.gz 2024-09-14T22:46:45.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46766.log 2024-09-14T22:46:45.629 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137084.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137084.log.gz 2024-09-14T22:46:45.629 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61061.log 2024-09-14T22:46:45.630 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46766.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46766.log.gz 2024-09-14T22:46:45.630 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45243.log 2024-09-14T22:46:45.631 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61061.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151571.log 2024-09-14T22:46:45.631 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61061.log.gz 2024-09-14T22:46:45.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45243.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45243.log.gz 2024-09-14T22:46:45.632 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58838.log 2024-09-14T22:46:45.632 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151571.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116660.log 2024-09-14T22:46:45.632 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151571.log.gz 2024-09-14T22:46:45.633 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58838.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58838.log.gz 2024-09-14T22:46:45.633 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37954.log 2024-09-14T22:46:45.634 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116660.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130131.log 2024-09-14T22:46:45.634 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.116660.log.gz 2024-09-14T22:46:45.635 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37954.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37954.log.gz 2024-09-14T22:46:45.635 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41195.log 2024-09-14T22:46:45.635 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130131.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152273.log 2024-09-14T22:46:45.635 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130131.log.gz 2024-09-14T22:46:45.636 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41195.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41195.log.gz 2024-09-14T22:46:45.636 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78047.log 2024-09-14T22:46:45.637 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152273.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster2-client.mirror.152273.log.gz --verbose 2024-09-14T22:46:45.637 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.admin.118871.log 2024-09-14T22:46:45.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78047.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78047.log.gz 2024-09-14T22:46:45.638 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98513.log 2024-09-14T22:46:45.638 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118871.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118871.log.gz 2024-09-14T22:46:45.639 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77499.log 2024-09-14T22:46:45.639 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98513.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98513.log.gz 2024-09-14T22:46:45.639 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144511.log 2024-09-14T22:46:45.640 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77499.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77499.log.gz 2024-09-14T22:46:45.640 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148306.log 2024-09-14T22:46:45.641 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144511.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144511.log.gz 2024-09-14T22:46:45.641 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68950.log 2024-09-14T22:46:45.642 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148306.log.gz 2024-09-14T22:46:45.642 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133700.log 2024-09-14T22:46:45.642 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68950.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68950.log.gz 2024-09-14T22:46:45.642 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49635.log 2024-09-14T22:46:45.643 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133700.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133700.log.gz 2024-09-14T22:46:45.643 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115660.log 2024-09-14T22:46:45.644 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49635.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106927.log 2024-09-14T22:46:45.644 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49635.log.gz 2024-09-14T22:46:45.645 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115660.log.gz 2024-09-14T22:46:45.645 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39998.log 2024-09-14T22:46:45.646 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106927.log.gz 2024-09-14T22:46:45.646 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117330.log 2024-09-14T22:46:45.647 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39998.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60268.log 2024-09-14T22:46:45.647 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39998.log.gz 2024-09-14T22:46:45.647 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117330.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117330.log.gz 2024-09-14T22:46:45.648 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115638.log 2024-09-14T22:46:45.648 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60268.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60268.log.gz 2024-09-14T22:46:45.649 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56023.log 2024-09-14T22:46:45.649 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115638.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115638.log.gz 2024-09-14T22:46:45.649 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80483.log 2024-09-14T22:46:45.650 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56023.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56023.log.gz 2024-09-14T22:46:45.650 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53751.log 2024-09-14T22:46:45.651 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80483.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80483.log.gz 2024-09-14T22:46:45.651 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113499.log 2024-09-14T22:46:45.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53751.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53751.log.gz 2024-09-14T22:46:45.652 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.35135.log 2024-09-14T22:46:45.652 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113499.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113499.log.gz 2024-09-14T22:46:45.653 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134391.log 2024-09-14T22:46:45.653 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.35135.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.35135.log.gz 2024-09-14T22:46:45.653 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83609.log 2024-09-14T22:46:45.654 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134391.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36243.log 2024-09-14T22:46:45.654 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134391.log.gz 2024-09-14T22:46:45.655 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83609.log.gz 2024-09-14T22:46:45.655 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60896.log 2024-09-14T22:46:45.655 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36243.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114213.log 2024-09-14T22:46:45.656 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36243.log.gz 2024-09-14T22:46:45.656 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60896.log.gz 2024-09-14T22:46:45.656 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49969.log 2024-09-14T22:46:45.657 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114213.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114213.log.gz 2024-09-14T22:46:45.657 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59324.log 2024-09-14T22:46:45.658 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49969.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49969.log.gz 2024-09-14T22:46:45.658 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143265.log 2024-09-14T22:46:45.659 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59324.log.gz 2024-09-14T22:46:45.659 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147825.log 2024-09-14T22:46:45.660 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143265.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143265.log.gz 2024-09-14T22:46:45.660 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117954.log 2024-09-14T22:46:45.661 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147825.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147825.log.gz 2024-09-14T22:46:45.661 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95709.log 2024-09-14T22:46:45.662 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117954.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117954.log.gz 2024-09-14T22:46:45.662 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79830.log 2024-09-14T22:46:45.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95709.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73462.log 2024-09-14T22:46:45.663 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95709.log.gz 2024-09-14T22:46:45.663 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79830.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79830.log.gz 2024-09-14T22:46:45.663 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52491.log 2024-09-14T22:46:45.664 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73462.log.gz 2024-09-14T22:46:45.664 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34193.log 2024-09-14T22:46:45.665 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52491.log.gz 2024-09-14T22:46:45.665 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64572.log 2024-09-14T22:46:45.666 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34193.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.90851.log 2024-09-14T22:46:45.666 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.34193.log.gz 2024-09-14T22:46:45.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64572.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64572.log.gz 2024-09-14T22:46:45.667 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122381.log 2024-09-14T22:46:45.667 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90851.log.gz 2024-09-14T22:46:45.668 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52637.log 2024-09-14T22:46:45.668 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122381.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122381.log.gz 2024-09-14T22:46:45.668 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123264.log 2024-09-14T22:46:45.669 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52637.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52637.log.gz 2024-09-14T22:46:45.669 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151572.log 2024-09-14T22:46:45.670 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123264.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123264.log.gz 2024-09-14T22:46:45.670 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70434.log 2024-09-14T22:46:45.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151572.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151572.log.gz 2024-09-14T22:46:45.671 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65808.log 2024-09-14T22:46:45.671 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70434.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70434.log.gz 2024-09-14T22:46:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107254.log 2024-09-14T22:46:45.672 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65808.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126593.log 2024-09-14T22:46:45.672 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65808.log.gz 2024-09-14T22:46:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107254.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107254.log.gz 2024-09-14T22:46:45.673 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108905.log 2024-09-14T22:46:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126593.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126593.log.gz 2024-09-14T22:46:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120490.log 2024-09-14T22:46:45.674 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108905.log.gz 2024-09-14T22:46:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120953.log 2024-09-14T22:46:45.675 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120490.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112174.log 2024-09-14T22:46:45.676 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120490.log.gz 2024-09-14T22:46:45.676 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120953.log.gz 2024-09-14T22:46:45.676 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37430.log 2024-09-14T22:46:45.677 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112174.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140523.log 2024-09-14T22:46:45.677 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112174.log.gz 2024-09-14T22:46:45.678 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37430.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37430.log.gz 2024-09-14T22:46:45.678 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109907.log 2024-09-14T22:46:45.679 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140523.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140523.log.gz 2024-09-14T22:46:45.679 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139750.log 2024-09-14T22:46:45.680 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109907.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109907.log.gz 2024-09-14T22:46:45.680 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147362.log 2024-09-14T22:46:45.680 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139750.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139750.log.gz 2024-09-14T22:46:45.680 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110435.log 2024-09-14T22:46:45.681 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147362.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147362.log.gz 2024-09-14T22:46:45.681 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94053.log 2024-09-14T22:46:45.682 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110435.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110435.log.gz 2024-09-14T22:46:45.682 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112028.log 2024-09-14T22:46:45.683 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94053.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94053.log.gz 2024-09-14T22:46:45.683 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122846.log 2024-09-14T22:46:45.684 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112028.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112028.log.gz 2024-09-14T22:46:45.684 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124631.log 2024-09-14T22:46:45.684 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122846.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137340.log 2024-09-14T22:46:45.684 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122846.log.gz 2024-09-14T22:46:45.685 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124631.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118985.log 2024-09-14T22:46:45.685 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124631.log.gz 2024-09-14T22:46:45.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137340.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137340.log.gz 2024-09-14T22:46:45.686 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90813.log 2024-09-14T22:46:45.686 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118985.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118985.log.gz 2024-09-14T22:46:45.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128516.log 2024-09-14T22:46:45.687 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90813.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90813.log.gz 2024-09-14T22:46:45.687 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47108.log 2024-09-14T22:46:45.688 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128516.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128516.log.gz 2024-09-14T22:46:45.688 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.104420.log 2024-09-14T22:46:45.689 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47108.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67812.log 2024-09-14T22:46:45.689 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47108.log.gz 2024-09-14T22:46:45.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.104420.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.104420.log.gz 2024-09-14T22:46:45.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125680.log 2024-09-14T22:46:45.690 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67812.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67812.log.gz 2024-09-14T22:46:45.690 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64505.log 2024-09-14T22:46:45.691 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125680.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68139.log 2024-09-14T22:46:45.691 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125680.log.gz 2024-09-14T22:46:45.692 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64505.log.gz 2024-09-14T22:46:45.692 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84599.log 2024-09-14T22:46:45.693 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68139.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68139.log.gz 2024-09-14T22:46:45.693 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117622.log 2024-09-14T22:46:45.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84599.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84599.log.gz 2024-09-14T22:46:45.694 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44333.log 2024-09-14T22:46:45.694 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117622.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117622.log.gz 2024-09-14T22:46:45.695 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73115.log 2024-09-14T22:46:45.696 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44333.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44333.log.gz 2024-09-14T22:46:45.696 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106338.log 2024-09-14T22:46:45.696 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73115.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60479.log 2024-09-14T22:46:45.696 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73115.log.gz 2024-09-14T22:46:45.697 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106338.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106338.log.gz 2024-09-14T22:46:45.697 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37265.log 2024-09-14T22:46:45.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60479.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60479.log.gz 2024-09-14T22:46:45.698 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100834.log 2024-09-14T22:46:45.698 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37265.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.35419.log 2024-09-14T22:46:45.699 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37265.log.gz 2024-09-14T22:46:45.699 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100834.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100834.log.gz 2024-09-14T22:46:45.699 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43154.log 2024-09-14T22:46:45.700 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.35419.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.94462.log 2024-09-14T22:46:45.700 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.35419.log.gz 2024-09-14T22:46:45.701 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43154.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43154.log.gz 2024-09-14T22:46:45.701 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.117154.log 2024-09-14T22:46:45.702 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.94462.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.94462.log.gz 2024-09-14T22:46:45.702 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117135.log 2024-09-14T22:46:45.703 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.117154.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.117154.log.gz 2024-09-14T22:46:45.703 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112394.log 2024-09-14T22:46:45.704 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117135.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46382.log 2024-09-14T22:46:45.704 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117135.log.gz 2024-09-14T22:46:45.705 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112394.log.gz 2024-09-14T22:46:45.705 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120210.log 2024-09-14T22:46:45.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46382.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46382.log.gz 2024-09-14T22:46:45.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129587.log 2024-09-14T22:46:45.706 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120210.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120210.log.gz 2024-09-14T22:46:45.706 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96755.log 2024-09-14T22:46:45.707 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129587.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129587.log.gz 2024-09-14T22:46:45.707 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147444.log 2024-09-14T22:46:45.708 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96755.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96755.log.gz 2024-09-14T22:46:45.708 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112112.log 2024-09-14T22:46:45.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147444.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147444.log.gz 2024-09-14T22:46:45.709 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51607.log 2024-09-14T22:46:45.709 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112112.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.112112.log.gz 2024-09-14T22:46:45.710 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84220.log 2024-09-14T22:46:45.710 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51607.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51607.log.gz 2024-09-14T22:46:45.710 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99701.log 2024-09-14T22:46:45.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84220.log.gz 2024-09-14T22:46:45.711 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74643.log 2024-09-14T22:46:45.712 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99701.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99701.log.gz 2024-09-14T22:46:45.712 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76701.log 2024-09-14T22:46:45.713 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74643.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74643.log.gz 2024-09-14T22:46:45.713 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134596.log 2024-09-14T22:46:45.714 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76701.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76701.log.gz 2024-09-14T22:46:45.714 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126460.log 2024-09-14T22:46:45.715 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134596.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134596.log.gz 2024-09-14T22:46:45.715 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47463.log 2024-09-14T22:46:45.716 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126460.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126460.log.gz 2024-09-14T22:46:45.716 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135051.log 2024-09-14T22:46:45.717 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47463.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109571.log 2024-09-14T22:46:45.717 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47463.log.gz 2024-09-14T22:46:45.717 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135051.log.gz 2024-09-14T22:46:45.718 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132050.log 2024-09-14T22:46:45.718 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109571.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109571.log.gz 2024-09-14T22:46:45.718 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55424.log 2024-09-14T22:46:45.719 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132050.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76221.log 2024-09-14T22:46:45.719 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132050.log.gz 2024-09-14T22:46:45.720 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55424.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.55424.log.gz -5 2024-09-14T22:46:45.720 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.151344.log 2024-09-14T22:46:45.720 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76221.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.76221.log.gz 2024-09-14T22:46:45.720 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118544.log 2024-09-14T22:46:45.721 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151344.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143510.log 2024-09-14T22:46:45.721 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151344.log.gz 2024-09-14T22:46:45.722 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118544.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118544.log.gz 2024-09-14T22:46:45.722 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61566.log 2024-09-14T22:46:45.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143510.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94327.log 2024-09-14T22:46:45.723 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143510.log.gz 2024-09-14T22:46:45.723 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61566.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61566.log.gz 2024-09-14T22:46:45.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71117.log 2024-09-14T22:46:45.724 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94327.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94327.log.gz 2024-09-14T22:46:45.724 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104341.log 2024-09-14T22:46:45.725 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71117.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133930.log 2024-09-14T22:46:45.725 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71117.log.gz 2024-09-14T22:46:45.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104341.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104341.log.gz 2024-09-14T22:46:45.726 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97148.log 2024-09-14T22:46:45.726 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133930.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133930.log.gz 2024-09-14T22:46:45.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127458.log 2024-09-14T22:46:45.727 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97148.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97148.log.gz 2024-09-14T22:46:45.727 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127459.log 2024-09-14T22:46:45.728 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127458.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55531.log 2024-09-14T22:46:45.728 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127458.log.gz 2024-09-14T22:46:45.729 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127459.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69552.log 2024-09-14T22:46:45.729 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127459.log.gz 2024-09-14T22:46:45.730 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55531.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55531.log.gz 2024-09-14T22:46:45.730 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108692.log 2024-09-14T22:46:45.731 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69552.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69552.log.gz 2024-09-14T22:46:45.731 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48684.log 2024-09-14T22:46:45.732 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108692.log.gz 2024-09-14T22:46:45.732 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81523.log 2024-09-14T22:46:45.732 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48684.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138880.log 2024-09-14T22:46:45.732 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48684.log.gz 2024-09-14T22:46:45.733 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81523.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81523.log.gz 2024-09-14T22:46:45.733 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109655.log 2024-09-14T22:46:45.734 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138880.log.gz 2024-09-14T22:46:45.734 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98051.log 2024-09-14T22:46:45.735 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109655.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109655.log.gz 2024-09-14T22:46:45.735 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112952.log 2024-09-14T22:46:45.736 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98051.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98051.log.gz 2024-09-14T22:46:45.736 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128777.log 2024-09-14T22:46:45.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112952.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147280.log 2024-09-14T22:46:45.737 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112952.log.gz 2024-09-14T22:46:45.737 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128777.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40541.log 2024-09-14T22:46:45.737 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128777.log.gz 2024-09-14T22:46:45.738 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147280.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147280.log.gz -5 2024-09-14T22:46:45.738 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster2-client.admin.81574.log 2024-09-14T22:46:45.739 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40541.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40541.log.gz 2024-09-14T22:46:45.739 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91574.log 2024-09-14T22:46:45.740 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81574.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.81727.log 0.0% 2024-09-14T22:46:45.740 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster2-client.admin.81574.log.gz 2024-09-14T22:46:45.740 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91574.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91574.log.gz 2024-09-14T22:46:45.741 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122487.log 2024-09-14T22:46:45.741 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.81727.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.81727.log.gz 2024-09-14T22:46:45.741 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103158.log 2024-09-14T22:46:45.742 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122487.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122487.log.gz 2024-09-14T22:46:45.742 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146774.log 2024-09-14T22:46:45.743 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103158.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89660.log 2024-09-14T22:46:45.743 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103158.log.gz 2024-09-14T22:46:45.744 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146774.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146774.log.gz 2024-09-14T22:46:45.744 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100111.log 2024-09-14T22:46:45.744 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89660.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89660.log.gz 2024-09-14T22:46:45.745 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.45764.log 2024-09-14T22:46:45.745 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100111.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100111.log.gz 2024-09-14T22:46:45.745 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63245.log 2024-09-14T22:46:45.746 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.45764.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.45764.log.gz 2024-09-14T22:46:45.746 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67918.log 2024-09-14T22:46:45.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63245.log.gz 2024-09-14T22:46:45.747 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40899.log 2024-09-14T22:46:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67918.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136416.log 2024-09-14T22:46:45.748 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67918.log.gz 2024-09-14T22:46:45.748 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40899.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40899.log.gz 2024-09-14T22:46:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.46056.log 2024-09-14T22:46:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136416.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136416.log.gz 2024-09-14T22:46:45.749 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71881.log 2024-09-14T22:46:45.750 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.46056.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.46056.log.gz 2024-09-14T22:46:45.750 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100784.log 2024-09-14T22:46:45.751 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71881.log.gz 2024-09-14T22:46:45.751 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84183.log 2024-09-14T22:46:45.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100784.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52827.log 2024-09-14T22:46:45.752 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100784.log.gz 2024-09-14T22:46:45.752 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84183.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84183.log.gz 2024-09-14T22:46:45.752 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38590.log 2024-09-14T22:46:45.753 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52827.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52827.log.gz 2024-09-14T22:46:45.753 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128337.log 2024-09-14T22:46:45.754 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38590.log.gz 2024-09-14T22:46:45.754 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91794.log 2024-09-14T22:46:45.755 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128337.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128337.log.gz 2024-09-14T22:46:45.755 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82436.log 2024-09-14T22:46:45.756 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91794.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91794.log.gz 2024-09-14T22:46:45.756 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148017.log 2024-09-14T22:46:45.757 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82436.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82436.log.gz 2024-09-14T22:46:45.757 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123792.log 2024-09-14T22:46:45.757 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148017.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148017.log.gz 2024-09-14T22:46:45.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76363.log 2024-09-14T22:46:45.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123792.log.gz 2024-09-14T22:46:45.759 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85962.log 2024-09-14T22:46:45.759 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76363.log.gz 2024-09-14T22:46:45.759 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120429.log 2024-09-14T22:46:45.760 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85962.log.gz 2024-09-14T22:46:45.760 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58127.log 2024-09-14T22:46:45.761 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120429.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111611.log 2024-09-14T22:46:45.761 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120429.log.gz 2024-09-14T22:46:45.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58127.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58127.log.gz 2024-09-14T22:46:45.762 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133928.log 2024-09-14T22:46:45.762 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111611.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111611.log.gz 2024-09-14T22:46:45.763 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124590.log 2024-09-14T22:46:45.764 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133928.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133928.log.gz 2024-09-14T22:46:45.764 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45003.log 2024-09-14T22:46:45.764 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124590.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124590.log.gz 2024-09-14T22:46:45.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80361.log 2024-09-14T22:46:45.765 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45003.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45003.log.gz 2024-09-14T22:46:45.765 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90941.log 2024-09-14T22:46:45.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80361.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80361.log.gz 2024-09-14T22:46:45.766 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37325.log 2024-09-14T22:46:45.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90941.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.90941.log.gz -- 2024-09-14T22:46:45.767 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.153754.log 2024-09-14T22:46:45.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37325.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37325.log.gz 2024-09-14T22:46:45.768 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136749.log 2024-09-14T22:46:45.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.153754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.153754.log.gz 2024-09-14T22:46:45.769 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58884.log 2024-09-14T22:46:45.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136749.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136749.log.gz 2024-09-14T22:46:45.769 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37831.log 2024-09-14T22:46:45.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58884.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.mirror.58884.log.gz 2024-09-14T22:46:45.770 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39514.log 2024-09-14T22:46:45.771 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37831.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37831.log.gz 2024-09-14T22:46:45.771 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.151678.log 2024-09-14T22:46:45.772 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39514.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.39514.log.gz 2024-09-14T22:46:45.772 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.95861.log 2024-09-14T22:46:45.772 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.151678.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.151678.log.gz 2024-09-14T22:46:45.773 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148117.log 2024-09-14T22:46:45.773 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95861.log.gz 2024-09-14T22:46:45.774 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87392.log 2024-09-14T22:46:45.774 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148117.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148117.log.gz 2024-09-14T22:46:45.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135785.log 2024-09-14T22:46:45.775 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87392.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87392.log.gz 2024-09-14T22:46:45.775 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.81954.log 2024-09-14T22:46:45.776 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135785.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135785.log.gz 2024-09-14T22:46:45.776 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136920.log 2024-09-14T22:46:45.777 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.81954.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.81954.log.gz 2024-09-14T22:46:45.777 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122680.log 2024-09-14T22:46:45.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136920.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136920.log.gz 2024-09-14T22:46:45.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38041.log 2024-09-14T22:46:45.778 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122680.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122680.log.gz 2024-09-14T22:46:45.778 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140908.log 2024-09-14T22:46:45.779 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38041.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38041.log.gz 2024-09-14T22:46:45.779 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48510.log 2024-09-14T22:46:45.780 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140908.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140908.log.gz 2024-09-14T22:46:45.780 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125133.log 2024-09-14T22:46:45.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48510.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48510.log.gz 2024-09-14T22:46:45.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92912.log 2024-09-14T22:46:45.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125133.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125133.log.gz 2024-09-14T22:46:45.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141915.log 2024-09-14T22:46:45.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92912.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92912.log.gz 2024-09-14T22:46:45.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57663.log 2024-09-14T22:46:45.783 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141915.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120428.log 2024-09-14T22:46:45.783 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141915.log.gz 2024-09-14T22:46:45.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57663.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57663.log.gz 2024-09-14T22:46:45.784 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119054.log 2024-09-14T22:46:45.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120428.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120428.log.gz 2024-09-14T22:46:45.784 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66398.log 2024-09-14T22:46:45.785 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119054.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.119054.log.gz -5 2024-09-14T22:46:45.785 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.admin.44304.log 2024-09-14T22:46:45.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66398.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66398.log.gz 2024-09-14T22:46:45.786 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50810.log 2024-09-14T22:46:45.786 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44304.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44304.log.gz 2024-09-14T22:46:45.787 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122911.log 2024-09-14T22:46:45.787 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50810.log.gz 2024-09-14T22:46:45.787 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89778.log 2024-09-14T22:46:45.788 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122911.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108086.log 2024-09-14T22:46:45.788 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122911.log.gz 2024-09-14T22:46:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89778.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89778.log.gz 2024-09-14T22:46:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121256.log 2024-09-14T22:46:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108086.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108086.log.gz 2024-09-14T22:46:45.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146248.log 2024-09-14T22:46:45.790 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121256.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121256.log.gz 2024-09-14T22:46:45.790 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99984.log 2024-09-14T22:46:45.791 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146248.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.146248.log.gz -- 2024-09-14T22:46:45.791 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.72862.log 2024-09-14T22:46:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99984.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99984.log.gz 2024-09-14T22:46:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59019.log 2024-09-14T22:46:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72862.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72862.log.gz 2024-09-14T22:46:45.792 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126705.log 2024-09-14T22:46:45.793 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59019.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59019.log.gz 2024-09-14T22:46:45.793 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70776.log 2024-09-14T22:46:45.796 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126705.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126705.log.gz 2024-09-14T22:46:45.796 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90835.log 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70776.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70776.log.gz 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150942.log 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90835.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90835.log.gz 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81902.log 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150942.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150942.log.gz 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92805.log 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81902.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81902.log.gz 2024-09-14T22:46:45.798 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129509.log 2024-09-14T22:46:45.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92805.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92805.log.gz 2024-09-14T22:46:45.799 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42474.log 2024-09-14T22:46:45.799 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129509.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129509.log.gz 2024-09-14T22:46:45.799 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65670.log 2024-09-14T22:46:45.800 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42474.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141895.log 2024-09-14T22:46:45.800 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42474.log.gz 2024-09-14T22:46:45.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65670.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65670.log.gz 2024-09-14T22:46:45.801 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67227.log 2024-09-14T22:46:45.801 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141895.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141895.log.gz 2024-09-14T22:46:45.801 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76076.log 2024-09-14T22:46:45.802 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67227.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67227.log.gz 2024-09-14T22:46:45.802 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133466.log 2024-09-14T22:46:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76076.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76076.log.gz 2024-09-14T22:46:45.803 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133549.log 2024-09-14T22:46:45.804 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133466.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133466.log.gz 2024-09-14T22:46:45.804 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94824.log 2024-09-14T22:46:45.805 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133549.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133549.log.gz 2024-09-14T22:46:45.805 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123751.log 2024-09-14T22:46:45.806 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94824.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94824.log.gz 2024-09-14T22:46:45.806 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101097.log 2024-09-14T22:46:45.807 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123751.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123751.log.gz 2024-09-14T22:46:45.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46477.log 2024-09-14T22:46:45.807 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101097.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101097.log.gz 2024-09-14T22:46:45.807 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76577.log 2024-09-14T22:46:45.808 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46477.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46477.log.gz 2024-09-14T22:46:45.808 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73237.log 2024-09-14T22:46:45.809 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76577.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76577.log.gz 2024-09-14T22:46:45.809 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135824.log 2024-09-14T22:46:45.810 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73237.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73237.log.gz 2024-09-14T22:46:45.810 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90850.log 2024-09-14T22:46:45.811 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135824.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144446.log 0.0% 2024-09-14T22:46:45.811 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.135824.log.gz 2024-09-14T22:46:45.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90850.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90850.log.gz 2024-09-14T22:46:45.812 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41817.log 2024-09-14T22:46:45.812 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144446.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144446.log.gz 2024-09-14T22:46:45.813 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34405.log 2024-09-14T22:46:45.813 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41817.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41817.log.gz 2024-09-14T22:46:45.814 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134348.log 2024-09-14T22:46:45.814 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34405.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79539.log 2024-09-14T22:46:45.814 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34405.log.gz 2024-09-14T22:46:45.815 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134348.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134348.log.gz 2024-09-14T22:46:45.815 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63168.log 2024-09-14T22:46:45.816 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79539.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79539.log.gz 2024-09-14T22:46:45.816 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.108365.log 2024-09-14T22:46:45.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63168.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63168.log.gz 2024-09-14T22:46:45.817 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91573.log 2024-09-14T22:46:45.817 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.108365.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.108365.log.gz 2024-09-14T22:46:45.818 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72905.log 2024-09-14T22:46:45.819 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91573.log.gz 2024-09-14T22:46:45.819 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135543.log 2024-09-14T22:46:45.819 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72905.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72905.log.gz 2024-09-14T22:46:45.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103550.log 2024-09-14T22:46:45.820 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135543.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135543.log.gz 2024-09-14T22:46:45.820 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92014.log 2024-09-14T22:46:45.821 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103550.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103550.log.gz 2024-09-14T22:46:45.821 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53119.log 2024-09-14T22:46:45.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92014.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92014.log.gz 2024-09-14T22:46:45.822 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60115.log 2024-09-14T22:46:45.822 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53119.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138076.log 0.0% 2024-09-14T22:46:45.822 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.53119.log.gz 2024-09-14T22:46:45.823 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60115.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60115.log.gz 2024-09-14T22:46:45.823 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45132.log 2024-09-14T22:46:45.824 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138076.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138076.log.gz 2024-09-14T22:46:45.824 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99600.log 2024-09-14T22:46:45.825 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45132.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45132.log.gz 2024-09-14T22:46:45.825 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.48464.log 2024-09-14T22:46:45.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99600.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152425.log 2024-09-14T22:46:45.826 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99600.log.gz 2024-09-14T22:46:45.826 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.48464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.48464.log.gz 2024-09-14T22:46:45.826 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86569.log 2024-09-14T22:46:45.827 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152425.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113794.log 2024-09-14T22:46:45.827 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152425.log.gz 2024-09-14T22:46:45.828 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86569.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86569.log.gz 2024-09-14T22:46:45.828 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69144.log 2024-09-14T22:46:45.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113794.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113794.log.gz 2024-09-14T22:46:45.829 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128317.log 2024-09-14T22:46:45.829 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69144.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69144.log.gz 2024-09-14T22:46:45.829 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60270.log 2024-09-14T22:46:45.830 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128317.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36393.log 2024-09-14T22:46:45.830 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128317.log.gz 2024-09-14T22:46:45.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60270.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60270.log.gz 2024-09-14T22:46:45.831 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112092.log 2024-09-14T22:46:45.831 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36393.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36393.log.gz 2024-09-14T22:46:45.831 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85481.log 2024-09-14T22:46:45.832 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112092.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112092.log.gz 2024-09-14T22:46:45.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99876.log 2024-09-14T22:46:45.833 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85481.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.85481.log.gz 2024-09-14T22:46:45.833 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster2-client.admin.34444.log 2024-09-14T22:46:45.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99876.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99876.log.gz 2024-09-14T22:46:45.834 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79941.log 2024-09-14T22:46:45.834 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34444.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34444.log.gz -5 2024-09-14T22:46:45.835 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.133839.log 2024-09-14T22:46:45.835 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79941.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79941.log.gz 2024-09-14T22:46:45.835 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93783.log 2024-09-14T22:46:45.836 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133839.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111212.log 2024-09-14T22:46:45.836 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133839.log.gz 2024-09-14T22:46:45.837 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93783.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93783.log.gz 2024-09-14T22:46:45.837 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75382.log 2024-09-14T22:46:45.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111212.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111212.log.gz 2024-09-14T22:46:45.838 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100531.log 2024-09-14T22:46:45.838 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75382.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75382.log.gz 2024-09-14T22:46:45.838 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95766.log 2024-09-14T22:46:45.839 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100531.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100531.log.gz 2024-09-14T22:46:45.839 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50156.log 2024-09-14T22:46:45.840 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95766.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95766.log.gz 2024-09-14T22:46:45.840 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90849.log 2024-09-14T22:46:45.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50156.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79410.log 2024-09-14T22:46:45.841 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50156.log.gz 2024-09-14T22:46:45.841 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90849.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.admin.90849.log.gz -- 2024-09-14T22:46:45.841 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.46746.log 2024-09-14T22:46:45.842 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79410.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79410.log.gz -5 2024-09-14T22:46:45.842 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.108965.log 2024-09-14T22:46:45.843 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46746.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46746.log.gz 2024-09-14T22:46:45.843 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114066.log 2024-09-14T22:46:45.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108965.log.gz 2024-09-14T22:46:45.844 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35957.log 2024-09-14T22:46:45.844 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114066.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114066.log.gz 2024-09-14T22:46:45.845 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.128891.log 2024-09-14T22:46:45.845 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35957.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.mirror.47394.log -- replaced with /var/log/ceph/cluster1-client.mirror.35957.log.gz 2024-09-14T22:46:45.845 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:45.846 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.128891.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.128891.log.gz 2024-09-14T22:46:45.846 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109698.log 2024-09-14T22:46:45.847 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47394.log.gz 2024-09-14T22:46:45.847 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86984.log 2024-09-14T22:46:45.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109698.log.gz 2024-09-14T22:46:45.848 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64529.log 2024-09-14T22:46:45.848 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86984.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.86984.log.gz --verbose 2024-09-14T22:46:45.849 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.134597.log 2024-09-14T22:46:45.849 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64529.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64529.log.gz 2024-09-14T22:46:45.849 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102147.log 2024-09-14T22:46:45.850 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134597.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.134597.log.gz 2024-09-14T22:46:45.850 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster2-client.mirror.118772.log 2024-09-14T22:46:45.851 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102147.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102147.log.gz 2024-09-14T22:46:45.851 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109487.log 2024-09-14T22:46:45.851 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118772.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118772.log.gz 2024-09-14T22:46:45.851 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137680.log 2024-09-14T22:46:45.852 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109487.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109487.log.gz 2024-09-14T22:46:45.852 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121458.log 2024-09-14T22:46:45.853 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137680.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.137680.log.gz 2024-09-14T22:46:45.853 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.149778.log 2024-09-14T22:46:45.854 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121458.log.gz 2024-09-14T22:46:45.854 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45350.log 2024-09-14T22:46:45.854 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149778.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38755.log 2024-09-14T22:46:45.855 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149778.log.gz 2024-09-14T22:46:45.855 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45350.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45350.log.gz 2024-09-14T22:46:45.855 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143069.log 2024-09-14T22:46:45.856 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38755.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38755.log.gz 2024-09-14T22:46:45.856 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114731.log 2024-09-14T22:46:45.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143069.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143069.log.gz 2024-09-14T22:46:45.857 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74014.log 2024-09-14T22:46:45.857 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114731.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.admin.114731.log.gz --verbose 2024-09-14T22:46:45.858 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.40774.log 2024-09-14T22:46:45.858 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74014.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74014.log.gz 2024-09-14T22:46:45.858 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69389.log 2024-09-14T22:46:45.859 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40774.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40774.log.gz 2024-09-14T22:46:45.859 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50809.log 2024-09-14T22:46:45.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69389.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.69389.log.gz 2024-09-14T22:46:45.860 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.129429.log 2024-09-14T22:46:45.860 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50809.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50809.log.gz 2024-09-14T22:46:45.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79874.log 2024-09-14T22:46:45.861 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129429.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129429.log.gz 2024-09-14T22:46:45.861 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147511.log 2024-09-14T22:46:45.862 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79874.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79874.log.gz 2024-09-14T22:46:45.862 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119053.log 2024-09-14T22:46:45.863 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147511.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111274.log 2024-09-14T22:46:45.863 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147511.log.gz 2024-09-14T22:46:45.863 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119053.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119053.log.gz 2024-09-14T22:46:45.864 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.59039.log 2024-09-14T22:46:45.864 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111274.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111274.log.gz 2024-09-14T22:46:45.864 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67205.log 2024-09-14T22:46:45.865 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.59039.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.59039.log.gz 2024-09-14T22:46:45.865 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42590.log 2024-09-14T22:46:45.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67205.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67205.log.gz 2024-09-14T22:46:45.866 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119624.log 2024-09-14T22:46:45.866 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42590.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106753.log 2024-09-14T22:46:45.867 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42590.log.gz 2024-09-14T22:46:45.867 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119624.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119624.log.gz 2024-09-14T22:46:45.867 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72819.log 2024-09-14T22:46:45.868 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106753.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106753.log.gz 2024-09-14T22:46:45.868 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52449.log 2024-09-14T22:46:45.869 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72819.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76642.log 2024-09-14T22:46:45.869 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72819.log.gz 2024-09-14T22:46:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52449.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52449.log.gz 2024-09-14T22:46:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60443.log 2024-09-14T22:46:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76642.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76642.log.gz 2024-09-14T22:46:45.871 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109153.log 2024-09-14T22:46:45.871 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60443.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60443.log.gz 2024-09-14T22:46:45.871 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137127.log 2024-09-14T22:46:45.872 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109153.log.gz 2024-09-14T22:46:45.872 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152753.log 2024-09-14T22:46:45.873 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137127.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.106431.log 2024-09-14T22:46:45.873 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137127.log.gz 2024-09-14T22:46:45.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152753.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152753.log.gz 2024-09-14T22:46:45.874 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129402.log 2024-09-14T22:46:45.874 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.106431.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.106431.log.gz 2024-09-14T22:46:45.875 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46565.log 2024-09-14T22:46:45.876 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129402.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129402.log.gz 2024-09-14T22:46:45.876 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69009.log 2024-09-14T22:46:45.876 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46565.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46565.log.gz 2024-09-14T22:46:45.876 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89951.log 2024-09-14T22:46:45.877 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69009.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69009.log.gz 2024-09-14T22:46:45.877 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63999.log 2024-09-14T22:46:45.878 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89951.log.gz 2024-09-14T22:46:45.878 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99020.log 2024-09-14T22:46:45.879 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63999.log.gz 2024-09-14T22:46:45.879 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109322.log 2024-09-14T22:46:45.879 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99020.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99020.log.gz 2024-09-14T22:46:45.880 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114803.log 2024-09-14T22:46:45.880 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109322.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109322.log.gz 2024-09-14T22:46:45.880 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138248.log 2024-09-14T22:46:45.881 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114803.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139997.log 2024-09-14T22:46:45.881 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114803.log.gz 2024-09-14T22:46:45.882 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138248.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138248.log.gz 2024-09-14T22:46:45.882 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.92498.log 2024-09-14T22:46:45.882 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139997.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139997.log.gz 2024-09-14T22:46:45.883 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56973.log 2024-09-14T22:46:45.883 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.92498.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.92498.log.gz 2024-09-14T22:46:45.883 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49592.log 2024-09-14T22:46:45.884 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56973.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56973.log.gz 2024-09-14T22:46:45.884 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124838.log 2024-09-14T22:46:45.885 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49592.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49592.log.gz 2024-09-14T22:46:45.885 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145935.log 2024-09-14T22:46:45.886 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124838.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124838.log.gz 2024-09-14T22:46:45.886 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108413.log 2024-09-14T22:46:45.886 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145935.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145935.log.gz 2024-09-14T22:46:45.887 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81219.log 2024-09-14T22:46:45.887 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108413.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108413.log.gz 2024-09-14T22:46:45.887 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123519.log 2024-09-14T22:46:45.888 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81219.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81219.log.gz 2024-09-14T22:46:45.888 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120367.log 2024-09-14T22:46:45.889 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123519.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123519.log.gz 2024-09-14T22:46:45.889 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68555.log 2024-09-14T22:46:45.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120367.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120367.log.gz 2024-09-14T22:46:45.890 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88440.log 2024-09-14T22:46:45.890 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68555.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41615.log 2024-09-14T22:46:45.891 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68555.log.gz 2024-09-14T22:46:45.891 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88440.log.gz 2024-09-14T22:46:45.891 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64299.log 2024-09-14T22:46:45.892 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41615.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41615.log.gz 2024-09-14T22:46:45.892 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95161.log 2024-09-14T22:46:45.893 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64299.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60615.log 2024-09-14T22:46:45.893 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64299.log.gz 2024-09-14T22:46:45.894 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95161.log.gz 2024-09-14T22:46:45.894 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.82477.log 2024-09-14T22:46:45.894 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60615.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60615.log.gz 2024-09-14T22:46:45.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108544.log 2024-09-14T22:46:45.895 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.82477.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.82477.log.gz 2024-09-14T22:46:45.895 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57936.log 2024-09-14T22:46:45.896 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108544.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108544.log.gz 2024-09-14T22:46:45.896 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74897.log 2024-09-14T22:46:45.897 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57936.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57936.log.gz 2024-09-14T22:46:45.897 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57997.log 2024-09-14T22:46:45.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74897.log.gz 2024-09-14T22:46:45.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114570.log 2024-09-14T22:46:45.898 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57997.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57997.log.gz 2024-09-14T22:46:45.898 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123998.log 2024-09-14T22:46:45.899 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114570.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114570.log.gz 2024-09-14T22:46:45.899 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130043.log 2024-09-14T22:46:45.900 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123998.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.105016.log 2024-09-14T22:46:45.900 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123998.log.gz 2024-09-14T22:46:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130043.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130043.log.gz 2024-09-14T22:46:45.901 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116507.log 2024-09-14T22:46:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.105016.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.105016.log.gz 2024-09-14T22:46:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92013.log 2024-09-14T22:46:45.902 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116507.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116507.log.gz 2024-09-14T22:46:45.903 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126666.log 2024-09-14T22:46:45.903 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92013.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92013.log.gz 2024-09-14T22:46:45.903 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128454.log 2024-09-14T22:46:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126666.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126666.log.gz 2024-09-14T22:46:45.904 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.118068.log 2024-09-14T22:46:45.905 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128454.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128454.log.gz 2024-09-14T22:46:45.905 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81025.log 2024-09-14T22:46:45.906 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.118068.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.118068.log.gz 2024-09-14T22:46:45.906 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121689.log 2024-09-14T22:46:45.906 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81025.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134305.log 2024-09-14T22:46:45.907 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81025.log.gz 2024-09-14T22:46:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121689.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121689.log.gz 2024-09-14T22:46:45.907 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54505.log 2024-09-14T22:46:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134305.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134305.log.gz 2024-09-14T22:46:45.908 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54548.log 2024-09-14T22:46:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54505.log.gz 2024-09-14T22:46:45.909 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144781.log 2024-09-14T22:46:45.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54548.log.gz 2024-09-14T22:46:45.910 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.58925.log 2024-09-14T22:46:45.910 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144781.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144781.log.gz 2024-09-14T22:46:45.910 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62379.log 2024-09-14T22:46:45.911 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58925.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.58925.log.gz 2024-09-14T22:46:45.911 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59875.log 2024-09-14T22:46:45.912 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62379.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62379.log.gz 2024-09-14T22:46:45.912 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153888.log 2024-09-14T22:46:45.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59875.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59875.log.gz 2024-09-14T22:46:45.913 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56432.log 2024-09-14T22:46:45.913 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153888.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153888.log.gz 2024-09-14T22:46:45.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103002.log 2024-09-14T22:46:45.914 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56432.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56432.log.gz 2024-09-14T22:46:45.914 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78048.log 2024-09-14T22:46:45.915 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103002.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103002.log.gz 2024-09-14T22:46:45.915 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131258.log 2024-09-14T22:46:45.916 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78048.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78048.log.gz 2024-09-14T22:46:45.916 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60792.log 2024-09-14T22:46:45.917 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131258.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131258.log.gz 2024-09-14T22:46:45.917 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149611.log 2024-09-14T22:46:45.920 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60792.log.gz 2024-09-14T22:46:45.920 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60028.log 2024-09-14T22:46:45.920 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149611.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149611.log.gz 2024-09-14T22:46:45.921 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66373.log 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60028.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60028.log.gz 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138056.log 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66373.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66373.log.gz 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88400.log 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138056.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138056.log.gz 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112430.log 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88400.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88400.log.gz 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100363.log 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112430.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112430.log.gz 2024-09-14T22:46:45.923 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127502.log 2024-09-14T22:46:45.924 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100363.log.gz 2024-09-14T22:46:45.924 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100235.log 2024-09-14T22:46:45.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127502.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127502.log.gz 2024-09-14T22:46:45.925 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40225.log 2024-09-14T22:46:45.925 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100235.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100235.log.gz 2024-09-14T22:46:45.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133127.log 2024-09-14T22:46:45.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40225.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40225.log.gz 2024-09-14T22:46:45.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53204.log 2024-09-14T22:46:45.926 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133127.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133127.log.gz 2024-09-14T22:46:45.926 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146204.log 2024-09-14T22:46:45.927 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53204.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53204.log.gz 2024-09-14T22:46:45.927 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86276.log 2024-09-14T22:46:45.928 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146204.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.146204.log.gz 2024-09-14T22:46:45.928 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38548.log 2024-09-14T22:46:45.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86276.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86276.log.gz 2024-09-14T22:46:45.929 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86507.log 2024-09-14T22:46:45.929 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38548.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38548.log.gz 2024-09-14T22:46:45.930 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100698.log 2024-09-14T22:46:45.931 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86507.log.gz 2024-09-14T22:46:45.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94851.log 2024-09-14T22:46:45.931 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100698.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100698.log.gz 2024-09-14T22:46:45.931 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108259.log 2024-09-14T22:46:45.932 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94851.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94851.log.gz 2024-09-14T22:46:45.932 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61356.log 2024-09-14T22:46:45.933 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108259.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108259.log.gz 2024-09-14T22:46:45.933 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74541.log 2024-09-14T22:46:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61356.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61356.log.gz 2024-09-14T22:46:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120910.log 2024-09-14T22:46:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74541.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74541.log.gz 2024-09-14T22:46:45.934 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87770.log 2024-09-14T22:46:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120910.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120910.log.gz 2024-09-14T22:46:45.935 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85898.log 2024-09-14T22:46:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87770.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87770.log.gz 2024-09-14T22:46:45.936 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61271.log 2024-09-14T22:46:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85898.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85898.log.gz 2024-09-14T22:46:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115684.log 2024-09-14T22:46:45.937 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61271.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61271.log.gz 2024-09-14T22:46:45.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39010.log 2024-09-14T22:46:45.938 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115684.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115684.log.gz 2024-09-14T22:46:45.938 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94167.log 2024-09-14T22:46:45.939 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39010.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39010.log.gz 2024-09-14T22:46:45.939 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110967.log 2024-09-14T22:46:45.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94167.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94167.log.gz 2024-09-14T22:46:45.940 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.140243.log 2024-09-14T22:46:45.940 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110967.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110967.log.gz 2024-09-14T22:46:45.941 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.130291.log 2024-09-14T22:46:45.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.140243.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.140243.log.gz 2024-09-14T22:46:45.942 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134697.log 2024-09-14T22:46:45.942 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.130291.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.130291.log.gz 2024-09-14T22:46:45.942 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86004.log 2024-09-14T22:46:45.943 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134697.log.gz 2024-09-14T22:46:45.943 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136543.log 2024-09-14T22:46:45.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86004.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54169.log 2024-09-14T22:46:45.944 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86004.log.gz 2024-09-14T22:46:45.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136543.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136543.log.gz 2024-09-14T22:46:45.945 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37785.log 2024-09-14T22:46:45.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54169.log.gz 2024-09-14T22:46:45.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100823.log 2024-09-14T22:46:45.946 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37785.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37785.log.gz 2024-09-14T22:46:45.946 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86404.log 2024-09-14T22:46:45.947 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100823.log.gz 2024-09-14T22:46:45.947 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118679.log 2024-09-14T22:46:45.948 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86404.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115574.log 2024-09-14T22:46:45.948 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86404.log.gz 2024-09-14T22:46:45.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118679.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.118679.log.gz 2024-09-14T22:46:45.949 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112953.log 2024-09-14T22:46:45.949 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115574.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115574.log.gz 2024-09-14T22:46:45.950 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143103.log 2024-09-14T22:46:45.950 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112953.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112953.log.gz 2024-09-14T22:46:45.950 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136881.log 2024-09-14T22:46:45.951 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143103.log.gz 2024-09-14T22:46:45.951 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94079.log 2024-09-14T22:46:45.952 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136881.log.gz 2024-09-14T22:46:45.952 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114448.log 2024-09-14T22:46:45.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94079.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94079.log.gz 2024-09-14T22:46:45.953 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62237.log 2024-09-14T22:46:45.953 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114448.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114448.log.gz 2024-09-14T22:46:45.954 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145223.log 2024-09-14T22:46:45.954 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62237.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62237.log.gz 2024-09-14T22:46:45.954 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40646.log 2024-09-14T22:46:45.955 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145223.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145223.log.gz 2024-09-14T22:46:45.955 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48185.log 2024-09-14T22:46:45.956 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40646.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40646.log.gz 2024-09-14T22:46:45.956 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39306.log 2024-09-14T22:46:45.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48185.log.gz 2024-09-14T22:46:45.957 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123220.log 2024-09-14T22:46:45.957 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39306.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39306.log.gz 2024-09-14T22:46:45.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94965.log 2024-09-14T22:46:45.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123220.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123220.log.gz 2024-09-14T22:46:45.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63039.log 2024-09-14T22:46:45.959 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94965.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94965.log.gz 2024-09-14T22:46:45.959 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151721.log 2024-09-14T22:46:45.960 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63039.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63039.log.gz 2024-09-14T22:46:45.960 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146101.log 2024-09-14T22:46:45.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151721.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151721.log.gz 2024-09-14T22:46:45.961 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107979.log 2024-09-14T22:46:45.961 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146101.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146101.log.gz 2024-09-14T22:46:45.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91508.log 2024-09-14T22:46:45.962 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107979.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107979.log.gz 2024-09-14T22:46:45.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129456.log 2024-09-14T22:46:45.963 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91508.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91508.log.gz 2024-09-14T22:46:45.963 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129990.log 2024-09-14T22:46:45.964 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129456.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129456.log.gz 2024-09-14T22:46:45.964 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79069.log 2024-09-14T22:46:45.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129990.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129990.log.gz 2024-09-14T22:46:45.965 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113753.log 2024-09-14T22:46:45.965 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79069.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79069.log.gz 2024-09-14T22:46:45.966 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82611.log 2024-09-14T22:46:45.966 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113753.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113753.log.gz 2024-09-14T22:46:45.966 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58998.log 2024-09-14T22:46:45.967 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82611.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82611.log.gz 2024-09-14T22:46:45.967 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78134.log 2024-09-14T22:46:45.968 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58998.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58998.log.gz 2024-09-14T22:46:45.968 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108610.log 2024-09-14T22:46:45.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78134.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78134.log.gz 2024-09-14T22:46:45.969 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136247.log 2024-09-14T22:46:45.969 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108610.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108610.log.gz 2024-09-14T22:46:45.969 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142769.log 2024-09-14T22:46:45.970 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136247.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136247.log.gz 2024-09-14T22:46:45.970 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39805.log 2024-09-14T22:46:45.971 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142769.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142769.log.gz 2024-09-14T22:46:45.971 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146292.log 2024-09-14T22:46:45.972 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39805.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39805.log.gz 2024-09-14T22:46:45.972 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88735.log 2024-09-14T22:46:45.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146292.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146292.log.gz 2024-09-14T22:46:45.973 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75189.log 2024-09-14T22:46:45.973 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88735.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88735.log.gz 2024-09-14T22:46:45.974 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54314.log 2024-09-14T22:46:45.974 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75189.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75189.log.gz 2024-09-14T22:46:45.974 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97673.log 2024-09-14T22:46:45.975 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54314.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54314.log.gz 2024-09-14T22:46:45.975 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93595.log 2024-09-14T22:46:45.976 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97673.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97673.log.gz 2024-09-14T22:46:45.976 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74506.log 2024-09-14T22:46:45.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93595.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93595.log.gz 2024-09-14T22:46:45.977 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62531.log 2024-09-14T22:46:45.977 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74506.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74506.log.gz 2024-09-14T22:46:45.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85584.log 2024-09-14T22:46:45.978 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62531.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62531.log.gz 2024-09-14T22:46:45.978 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38254.log 2024-09-14T22:46:45.979 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85584.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85584.log.gz 2024-09-14T22:46:45.979 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88649.log 2024-09-14T22:46:45.980 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38254.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.126206.log 2024-09-14T22:46:45.980 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38254.log.gz 2024-09-14T22:46:45.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88649.log.gz 2024-09-14T22:46:45.981 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132855.log 2024-09-14T22:46:45.981 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.126206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.126206.log.gz 2024-09-14T22:46:45.982 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134347.log 2024-09-14T22:46:45.982 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132855.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132855.log.gz 2024-09-14T22:46:45.982 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74012.log 2024-09-14T22:46:45.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134347.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134347.log.gz 2024-09-14T22:46:45.984 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63455.log 2024-09-14T22:46:45.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74012.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74012.log.gz 2024-09-14T22:46:45.984 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44079.log 2024-09-14T22:46:45.985 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63455.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63455.log.gz 2024-09-14T22:46:45.985 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113793.log 2024-09-14T22:46:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44079.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44079.log.gz 2024-09-14T22:46:45.986 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41799.log 2024-09-14T22:46:45.987 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113793.log.gz 2024-09-14T22:46:45.987 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77919.log 2024-09-14T22:46:45.987 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41799.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41799.log.gz 2024-09-14T22:46:45.987 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49904.log 2024-09-14T22:46:45.988 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77919.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77919.log.gz 2024-09-14T22:46:45.988 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144803.log 2024-09-14T22:46:45.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49904.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49904.log.gz 2024-09-14T22:46:45.989 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71444.log 2024-09-14T22:46:45.989 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144803.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144803.log.gz 2024-09-14T22:46:45.990 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98343.log 2024-09-14T22:46:45.990 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71444.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71444.log.gz 2024-09-14T22:46:45.990 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50474.log 2024-09-14T22:46:45.991 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98343.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98343.log.gz 2024-09-14T22:46:45.992 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128718.log 2024-09-14T22:46:45.992 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50474.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50474.log.gz 2024-09-14T22:46:45.992 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146081.log 2024-09-14T22:46:45.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128718.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128718.log.gz 2024-09-14T22:46:45.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75654.log 2024-09-14T22:46:45.993 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146081.log.gz 2024-09-14T22:46:45.993 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38440.log 2024-09-14T22:46:45.994 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75654.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75654.log.gz 2024-09-14T22:46:45.994 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105502.log 2024-09-14T22:46:45.995 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38440.log.gz 2024-09-14T22:46:45.995 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51105.log 2024-09-14T22:46:45.996 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105502.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105502.log.gz 2024-09-14T22:46:45.996 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138923.log 2024-09-14T22:46:45.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51105.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51105.log.gz 2024-09-14T22:46:45.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35527.log 2024-09-14T22:46:45.997 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138923.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.138923.log.gz 2024-09-14T22:46:45.997 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107037.log 2024-09-14T22:46:45.998 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35527.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35527.log.gz 2024-09-14T22:46:45.998 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35306.log 2024-09-14T22:46:45.999 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107037.log.gz 2024-09-14T22:46:45.999 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68237.log 2024-09-14T22:46:46.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35306.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35306.log.gz 2024-09-14T22:46:46.000 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104262.log 2024-09-14T22:46:46.000 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68237.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.68237.log.gz 2024-09-14T22:46:46.001 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136839.log 2024-09-14T22:46:46.001 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104262.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104262.log.gz 2024-09-14T22:46:46.001 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91354.log 2024-09-14T22:46:46.002 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136839.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136839.log.gz 2024-09-14T22:46:46.002 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145831.log 2024-09-14T22:46:46.003 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91354.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91354.log.gz 2024-09-14T22:46:46.003 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134095.log 2024-09-14T22:46:46.004 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145831.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145831.log.gz 2024-09-14T22:46:46.004 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98451.log 2024-09-14T22:46:46.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134095.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134095.log.gz 2024-09-14T22:46:46.005 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152398.log 2024-09-14T22:46:46.005 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98451.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98451.log.gz 2024-09-14T22:46:46.005 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149800.log 2024-09-14T22:46:46.006 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152398.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100113.log 2024-09-14T22:46:46.006 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152398.log.gz 2024-09-14T22:46:46.007 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149800.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149800.log.gz 2024-09-14T22:46:46.007 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55049.log 2024-09-14T22:46:46.008 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100113.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100113.log.gz 2024-09-14T22:46:46.008 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72081.log 2024-09-14T22:46:46.008 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55049.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55049.log.gz 2024-09-14T22:46:46.008 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77604.log 2024-09-14T22:46:46.009 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72081.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135574.log 2024-09-14T22:46:46.009 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72081.log.gz 2024-09-14T22:46:46.010 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77604.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77604.log.gz 2024-09-14T22:46:46.010 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62004.log 2024-09-14T22:46:46.011 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135574.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135574.log.gz 2024-09-14T22:46:46.011 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88231.log 2024-09-14T22:46:46.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62004.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62004.log.gz 2024-09-14T22:46:46.012 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44277.log 2024-09-14T22:46:46.012 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88231.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88231.log.gz 2024-09-14T22:46:46.013 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67826.log 2024-09-14T22:46:46.013 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44277.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69929.log 2024-09-14T22:46:46.014 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44277.log.gz 2024-09-14T22:46:46.014 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67826.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67826.log.gz 2024-09-14T22:46:46.014 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109505.log 2024-09-14T22:46:46.015 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69929.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69929.log.gz 2024-09-14T22:46:46.015 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.47878.log 2024-09-14T22:46:46.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109505.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.109505.log.gz -- 2024-09-14T22:46:46.016 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.145810.log 2024-09-14T22:46:46.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.47878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.47878.log.gz 2024-09-14T22:46:46.016 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130868.log 2024-09-14T22:46:46.017 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145810.log.gz 2024-09-14T22:46:46.017 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56357.log 2024-09-14T22:46:46.018 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130868.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102765.log 2024-09-14T22:46:46.018 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130868.log.gz 2024-09-14T22:46:46.019 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56357.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56357.log.gz 2024-09-14T22:46:46.019 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49300.log 2024-09-14T22:46:46.019 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102765.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64420.log 2024-09-14T22:46:46.020 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102765.log.gz 2024-09-14T22:46:46.020 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49300.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49300.log.gz 2024-09-14T22:46:46.020 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132897.log 2024-09-14T22:46:46.021 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64420.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64420.log.gz 2024-09-14T22:46:46.021 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148771.log 2024-09-14T22:46:46.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132897.log.gz 2024-09-14T22:46:46.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43100.log 2024-09-14T22:46:46.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148771.log.gz 2024-09-14T22:46:46.023 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110852.log 2024-09-14T22:46:46.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43100.log.gz 2024-09-14T22:46:46.024 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.138793.log 2024-09-14T22:46:46.025 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110852.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62425.log 0.0% 2024-09-14T22:46:46.025 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.110852.log.gz 2024-09-14T22:46:46.025 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.138793.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/cluster1-client.admin.138793.log.gz /var/log/ceph/cluster1-client.mirror.85668.log 2024-09-14T22:46:46.025 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:46.026 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62425.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62425.log.gz 2024-09-14T22:46:46.026 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148852.log 2024-09-14T22:46:46.027 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85668.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85668.log.gz 2024-09-14T22:46:46.027 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134096.log 2024-09-14T22:46:46.028 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148852.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148852.log.gz 2024-09-14T22:46:46.028 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63037.log 2024-09-14T22:46:46.028 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134096.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134096.log.gz 2024-09-14T22:46:46.029 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78237.log 2024-09-14T22:46:46.029 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63037.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136666.log 2024-09-14T22:46:46.029 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63037.log.gz 2024-09-14T22:46:46.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78237.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78237.log.gz 2024-09-14T22:46:46.030 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.118156.log 2024-09-14T22:46:46.031 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136666.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136666.log.gz 2024-09-14T22:46:46.031 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51649.log 2024-09-14T22:46:46.032 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.118156.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.118156.log.gz 2024-09-14T22:46:46.032 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75588.log 2024-09-14T22:46:46.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51649.log.gz 2024-09-14T22:46:46.033 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111823.log 2024-09-14T22:46:46.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75588.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95815.log 2024-09-14T22:46:46.034 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75588.log.gz 2024-09-14T22:46:46.034 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111823.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111823.log.gz 2024-09-14T22:46:46.034 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127722.log 2024-09-14T22:46:46.035 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95815.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.95815.log.gz 2024-09-14T22:46:46.035 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120745.log 2024-09-14T22:46:46.036 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127722.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127722.log.gz 2024-09-14T22:46:46.036 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38968.log 2024-09-14T22:46:46.037 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120745.log.gz 2024-09-14T22:46:46.037 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60505.log 2024-09-14T22:46:46.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38968.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38968.log.gz 2024-09-14T22:46:46.038 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65410.log 2024-09-14T22:46:46.038 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60505.log.gz 2024-09-14T22:46:46.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84419.log 2024-09-14T22:46:46.039 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65410.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65410.log.gz 2024-09-14T22:46:46.039 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120323.log 2024-09-14T22:46:46.040 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84419.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84419.log.gz 2024-09-14T22:46:46.040 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115147.log 2024-09-14T22:46:46.041 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120323.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120323.log.gz 2024-09-14T22:46:46.041 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70119.log 2024-09-14T22:46:46.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115147.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115147.log.gz 2024-09-14T22:46:46.042 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129607.log 2024-09-14T22:46:46.042 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70119.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.70119.log.gz -5 2024-09-14T22:46:46.042 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.90682.log 2024-09-14T22:46:46.043 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129607.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129607.log.gz 2024-09-14T22:46:46.043 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.46793.log 2024-09-14T22:46:46.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90682.log.gz 2024-09-14T22:46:46.044 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131132.log 2024-09-14T22:46:46.044 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.46793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.46793.log.gz 2024-09-14T22:46:46.045 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40691.log 2024-09-14T22:46:46.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131132.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131132.log.gz 2024-09-14T22:46:46.046 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46403.log 2024-09-14T22:46:46.046 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40691.log.gz 2024-09-14T22:46:46.046 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95292.log 2024-09-14T22:46:46.047 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46403.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46403.log.gz 2024-09-14T22:46:46.047 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135762.log 2024-09-14T22:46:46.048 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95292.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.95292.log.gz 2024-09-14T22:46:46.048 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.72187.log 2024-09-14T22:46:46.049 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135762.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135762.log.gz 2024-09-14T22:46:46.049 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99524.log 2024-09-14T22:46:46.049 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.72187.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.72187.log.gz 2024-09-14T22:46:46.050 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122068.log 2024-09-14T22:46:46.050 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99524.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99524.log.gz 2024-09-14T22:46:46.050 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123161.log 2024-09-14T22:46:46.051 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122068.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122068.log.gz 2024-09-14T22:46:46.051 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123518.log 2024-09-14T22:46:46.052 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123161.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123161.log.gz 2024-09-14T22:46:46.052 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95293.log 2024-09-14T22:46:46.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123518.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123518.log.gz 2024-09-14T22:46:46.053 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80307.log 2024-09-14T22:46:46.053 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95293.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43143.log 2024-09-14T22:46:46.054 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95293.log.gz 2024-09-14T22:46:46.054 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80307.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80307.log.gz 2024-09-14T22:46:46.054 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34615.log 2024-09-14T22:46:46.055 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43143.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43143.log.gz 2024-09-14T22:46:46.055 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.33853.log 2024-09-14T22:46:46.056 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34615.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34615.log.gz 2024-09-14T22:46:46.056 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78640.log 2024-09-14T22:46:46.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.33853.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.33853.log.gz 2024-09-14T22:46:46.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91577.log 2024-09-14T22:46:46.057 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78640.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78640.log.gz 2024-09-14T22:46:46.057 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137507.log 2024-09-14T22:46:46.058 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91577.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91577.log.gz 2024-09-14T22:46:46.058 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137085.log 2024-09-14T22:46:46.059 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137507.log.gz 2024-09-14T22:46:46.059 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119969.log 2024-09-14T22:46:46.060 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137085.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137085.log.gz 2024-09-14T22:46:46.060 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100951.log 2024-09-14T22:46:46.061 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119969.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119969.log.gz 2024-09-14T22:46:46.061 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38754.log 2024-09-14T22:46:46.062 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100951.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100951.log.gz 2024-09-14T22:46:46.062 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40967.log 2024-09-14T22:46:46.062 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38754.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38754.log.gz 2024-09-14T22:46:46.063 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.70186.log 2024-09-14T22:46:46.063 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40967.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40967.log.gz 2024-09-14T22:46:46.063 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145515.log 2024-09-14T22:46:46.064 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.70186.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.70186.log.gz 2024-09-14T22:46:46.064 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147907.log 2024-09-14T22:46:46.065 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50198.log 2024-09-14T22:46:46.065 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145515.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145515.log.gz 2024-09-14T22:46:46.066 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147907.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147907.log.gz 2024-09-14T22:46:46.066 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.68440.log 2024-09-14T22:46:46.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50198.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50198.log.gz 2024-09-14T22:46:46.067 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66288.log 2024-09-14T22:46:46.067 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.68440.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.68440.log.gz 2024-09-14T22:46:46.067 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51861.log 2024-09-14T22:46:46.068 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66288.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66288.log.gz 2024-09-14T22:46:46.068 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111210.log 2024-09-14T22:46:46.069 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51861.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51861.log.gz 2024-09-14T22:46:46.069 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.151973.log 2024-09-14T22:46:46.070 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111210.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111210.log.gz 2024-09-14T22:46:46.070 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35895.log 2024-09-14T22:46:46.070 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.151973.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.151973.log.gz 2024-09-14T22:46:46.071 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63268.log 2024-09-14T22:46:46.071 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35895.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35895.log.gz 2024-09-14T22:46:46.071 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87243.log 2024-09-14T22:46:46.072 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63268.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63268.log.gz 2024-09-14T22:46:46.072 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108819.log 2024-09-14T22:46:46.073 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87243.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87243.log.gz 2024-09-14T22:46:46.073 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73173.log 2024-09-14T22:46:46.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108819.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108819.log.gz 2024-09-14T22:46:46.074 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117146.log 2024-09-14T22:46:46.074 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73173.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73173.log.gz 2024-09-14T22:46:46.075 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53371.log 2024-09-14T22:46:46.075 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117146.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117146.log.gz 2024-09-14T22:46:46.075 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.106157.log 2024-09-14T22:46:46.076 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53371.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53371.log.gzgzip 2024-09-14T22:46:46.076 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75810.log 2024-09-14T22:46:46.077 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.106157.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.106157.log.gz 2024-09-14T22:46:46.077 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.99395.log 2024-09-14T22:46:46.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75810.log.gz 2024-09-14T22:46:46.078 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.141781.log 2024-09-14T22:46:46.078 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.99395.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.99395.log.gz 2024-09-14T22:46:46.079 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136547.log 2024-09-14T22:46:46.079 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.141781.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.141781.log.gz 2024-09-14T22:46:46.079 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45856.log 2024-09-14T22:46:46.080 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136547.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136547.log.gz 2024-09-14T22:46:46.080 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92725.log 2024-09-14T22:46:46.081 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45856.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45856.log.gz 2024-09-14T22:46:46.081 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41507.log 2024-09-14T22:46:46.082 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92725.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92725.log.gz 2024-09-14T22:46:46.082 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112834.log 2024-09-14T22:46:46.082 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41507.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41507.log.gz 2024-09-14T22:46:46.083 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147509.log 2024-09-14T22:46:46.083 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112834.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112834.log.gz 2024-09-14T22:46:46.083 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127239.log 2024-09-14T22:46:46.084 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147509.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116279.log 2024-09-14T22:46:46.084 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147509.log.gz 2024-09-14T22:46:46.085 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127239.log.gz 2024-09-14T22:46:46.085 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149404.log 2024-09-14T22:46:46.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116279.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116279.log.gz 2024-09-14T22:46:46.086 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132438.log 2024-09-14T22:46:46.086 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149404.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149404.log.gz 2024-09-14T22:46:46.086 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125367.log 2024-09-14T22:46:46.087 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132438.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132438.log.gz 2024-09-14T22:46:46.087 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70206.log 2024-09-14T22:46:46.088 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125367.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125367.log.gz 2024-09-14T22:46:46.088 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90416.log 2024-09-14T22:46:46.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70206.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70206.log.gz 2024-09-14T22:46:46.089 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60331.log 2024-09-14T22:46:46.089 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90416.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90416.log.gz 2024-09-14T22:46:46.090 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107363.log 2024-09-14T22:46:46.090 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60331.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60331.log.gz 2024-09-14T22:46:46.090 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131046.log 2024-09-14T22:46:46.091 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107363.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107363.log.gz 2024-09-14T22:46:46.091 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87641.log 2024-09-14T22:46:46.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131046.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88692.log 2024-09-14T22:46:46.092 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131046.log.gz 2024-09-14T22:46:46.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87641.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87641.log.gz 2024-09-14T22:46:46.093 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56771.log 2024-09-14T22:46:46.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88692.log.gz 2024-09-14T22:46:46.094 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79457.log 2024-09-14T22:46:46.094 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56771.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56771.log.gz 2024-09-14T22:46:46.094 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114885.log 2024-09-14T22:46:46.095 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79457.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79457.log.gz 2024-09-14T22:46:46.095 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65000.log 2024-09-14T22:46:46.096 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114885.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63878.log 2024-09-14T22:46:46.096 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114885.log.gz 2024-09-14T22:46:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65000.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53499.log 2024-09-14T22:46:46.097 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65000.log.gz 2024-09-14T22:46:46.097 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63878.log.gz 2024-09-14T22:46:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102252.log 2024-09-14T22:46:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53499.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53499.log.gz 2024-09-14T22:46:46.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146369.log 2024-09-14T22:46:46.099 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102252.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102252.log.gz 2024-09-14T22:46:46.099 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80739.log 2024-09-14T22:46:46.100 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146369.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146369.log.gz 2024-09-14T22:46:46.100 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110392.log 2024-09-14T22:46:46.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80739.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80739.log.gz 2024-09-14T22:46:46.101 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135582.log 2024-09-14T22:46:46.101 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110392.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110392.log.gz 2024-09-14T22:46:46.101 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124523.log 2024-09-14T22:46:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135582.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135582.log.gz 2024-09-14T22:46:46.102 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61794.log 2024-09-14T22:46:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124523.log.gz 2024-09-14T22:46:46.103 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108481.log 2024-09-14T22:46:46.104 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61794.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109844.log 2024-09-14T22:46:46.104 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61794.log.gz 2024-09-14T22:46:46.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108481.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108481.log.gz 2024-09-14T22:46:46.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62740.log 2024-09-14T22:46:46.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109844.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89868.log 2024-09-14T22:46:46.106 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109844.log.gz 2024-09-14T22:46:46.106 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62740.log.gz 2024-09-14T22:46:46.106 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109380.log 2024-09-14T22:46:46.107 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89868.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89868.log.gz 2024-09-14T22:46:46.107 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87241.log 2024-09-14T22:46:46.108 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109380.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109380.log.gz 2024-09-14T22:46:46.108 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89615.log 2024-09-14T22:46:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87241.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87241.log.gz 2024-09-14T22:46:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135491.log 2024-09-14T22:46:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89615.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89615.log.gz 2024-09-14T22:46:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150159.log 2024-09-14T22:46:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135491.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135491.log.gz 2024-09-14T22:46:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.81915.log 2024-09-14T22:46:46.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150159.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150159.log.gz 2024-09-14T22:46:46.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124946.log 2024-09-14T22:46:46.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81915.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81915.log.gz 2024-09-14T22:46:46.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146773.log 2024-09-14T22:46:46.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124946.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124946.log.gz 2024-09-14T22:46:46.113 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.81675.log 2024-09-14T22:46:46.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146773.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/cluster1-client.mirror.146773.log.gz /var/log/ceph/cluster1-client.admin.139954.log 2024-09-14T22:46:46.113 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:46.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.81675.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.81675.log.gz 2024-09-14T22:46:46.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140813.log 2024-09-14T22:46:46.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139954.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139954.log.gz 2024-09-14T22:46:46.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149612.log 2024-09-14T22:46:46.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140813.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140813.log.gz 2024-09-14T22:46:46.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119970.log 2024-09-14T22:46:46.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149612.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149612.log.gz 2024-09-14T22:46:46.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.122240.log 2024-09-14T22:46:46.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119970.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119970.log.gz 2024-09-14T22:46:46.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120037.log 2024-09-14T22:46:46.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.122240.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.122240.log.gz 2024-09-14T22:46:46.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125218.log 2024-09-14T22:46:46.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120037.log.gz 2024-09-14T22:46:46.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145995.log 2024-09-14T22:46:46.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125218.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125218.log.gz 2024-09-14T22:46:46.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136667.log 2024-09-14T22:46:46.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145995.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.71312.log 2024-09-14T22:46:46.120 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145995.log.gz 2024-09-14T22:46:46.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136667.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136667.log.gz 2024-09-14T22:46:46.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.71965.log 2024-09-14T22:46:46.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.71312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.71312.log.gz 2024-09-14T22:46:46.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48069.log 2024-09-14T22:46:46.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.71965.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.47161.log 2024-09-14T22:46:46.123 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.71965.log.gz 2024-09-14T22:46:46.124 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48069.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.48069.log.gz -5 2024-09-14T22:46:46.124 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.63791.log 2024-09-14T22:46:46.125 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.47161.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101243.log 2024-09-14T22:46:46.125 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.47161.log.gz 2024-09-14T22:46:46.125 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63791.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.63791.log.gz -- 2024-09-14T22:46:46.125 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.113501.log 2024-09-14T22:46:46.126 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101243.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101243.log.gz 2024-09-14T22:46:46.126 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49279.log 2024-09-14T22:46:46.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113501.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.113501.log.gz --verbose 2024-09-14T22:46:46.127 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster2-client.admin.34531.log 2024-09-14T22:46:46.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49279.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49279.log.gz 2024-09-14T22:46:46.128 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85311.log 2024-09-14T22:46:46.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34531.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66437.log 2024-09-14T22:46:46.128 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34531.log.gz 2024-09-14T22:46:46.129 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85311.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85311.log.gz 2024-09-14T22:46:46.129 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52659.log 2024-09-14T22:46:46.130 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66437.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89027.log 2024-09-14T22:46:46.130 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66437.log.gz 2024-09-14T22:46:46.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52659.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52659.log.gz 2024-09-14T22:46:46.131 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119091.log 2024-09-14T22:46:46.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89027.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54464.log 2024-09-14T22:46:46.132 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89027.log.gz 2024-09-14T22:46:46.132 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119091.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119091.log.gz 2024-09-14T22:46:46.132 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131745.log 2024-09-14T22:46:46.133 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54464.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54464.log.gz 2024-09-14T22:46:46.133 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.128135.log 2024-09-14T22:46:46.134 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131745.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131745.log.gz 2024-09-14T22:46:46.134 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86970.log 2024-09-14T22:46:46.135 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.128135.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.128135.log.gz 2024-09-14T22:46:46.135 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152736.log 2024-09-14T22:46:46.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86970.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86970.log.gz 2024-09-14T22:46:46.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.96531.log 2024-09-14T22:46:46.136 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152736.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152736.log.gz 2024-09-14T22:46:46.136 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100950.log 2024-09-14T22:46:46.137 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.96531.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.96531.log.gz 2024-09-14T22:46:46.137 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.126997.log 2024-09-14T22:46:46.138 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100950.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100950.log.gz 2024-09-14T22:46:46.138 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96208.log 2024-09-14T22:46:46.139 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.126997.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.126997.log.gz 2024-09-14T22:46:46.139 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102699.log 2024-09-14T22:46:46.139 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96208.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96208.log.gz 2024-09-14T22:46:46.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148202.log 2024-09-14T22:46:46.140 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102699.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102699.log.gz 2024-09-14T22:46:46.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65810.log 2024-09-14T22:46:46.141 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148202.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148202.log.gz 2024-09-14T22:46:46.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144301.log 2024-09-14T22:46:46.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65810.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65810.log.gz 2024-09-14T22:46:46.142 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104952.log 2024-09-14T22:46:46.142 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144301.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144301.log.gz 2024-09-14T22:46:46.143 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55005.log 2024-09-14T22:46:46.143 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104952.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104952.log.gz 2024-09-14T22:46:46.144 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35067.log 2024-09-14T22:46:46.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55005.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55005.log.gz 2024-09-14T22:46:46.145 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150313.log 2024-09-14T22:46:46.145 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35067.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35067.log.gz 2024-09-14T22:46:46.146 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121122.log 2024-09-14T22:46:46.147 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150313.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150313.log.gz 2024-09-14T22:46:46.147 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40121.log 2024-09-14T22:46:46.147 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121122.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121122.log.gz 2024-09-14T22:46:46.147 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146436.log 2024-09-14T22:46:46.148 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40121.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40121.log.gz 2024-09-14T22:46:46.148 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124567.log 2024-09-14T22:46:46.149 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146436.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146436.log.gz 2024-09-14T22:46:46.149 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67007.log 2024-09-14T22:46:46.150 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124567.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124567.log.gz 2024-09-14T22:46:46.150 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2.log 2024-09-14T22:46:46.150 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67007.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67007.log.gz 2024-09-14T22:46:46.151 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.101407.log 2024-09-14T22:46:46.151 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94193.log 2024-09-14T22:46:46.152 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.101407.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.101407.log.gz 2024-09-14T22:46:46.152 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61211.log 2024-09-14T22:46:46.153 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94193.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94193.log.gz 2024-09-14T22:46:46.153 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92723.log 2024-09-14T22:46:46.154 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.153277.log 2024-09-14T22:46:46.154 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61211.log.gz 2024-09-14T22:46:46.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92723.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92723.log.gz 2024-09-14T22:46:46.155 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49287.log 2024-09-14T22:46:46.155 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.153277.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41505.log 2024-09-14T22:46:46.156 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.153277.log.gz 2024-09-14T22:46:46.156 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49287.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49287.log.gz 2024-09-14T22:46:46.156 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80165.log 2024-09-14T22:46:46.157 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41505.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41505.log.gz 2024-09-14T22:46:46.157 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131919.log 2024-09-14T22:46:46.158 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.114536.log 2024-09-14T22:46:46.158 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80165.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80165.log.gz 2024-09-14T22:46:46.159 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131919.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91682.log 2024-09-14T22:46:46.159 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131919.log.gz 2024-09-14T22:46:46.160 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.114536.log: 87.9% -- replaced with /var/log/ceph/cluster2.log.gz 2024-09-14T22:46:46.160 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.114536.log.gz 2024-09-14T22:46:46.160 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68007.log 2024-09-14T22:46:46.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91682.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91682.log.gz 2024-09-14T22:46:46.161 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82638.log 2024-09-14T22:46:46.161 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68007.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54837.log 2024-09-14T22:46:46.162 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68007.log.gz 2024-09-14T22:46:46.162 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82638.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82638.log.gz -5 2024-09-14T22:46:46.162 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.84915.log 2024-09-14T22:46:46.163 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54837.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86801.log 2024-09-14T22:46:46.163 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54837.log.gz 2024-09-14T22:46:46.164 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84915.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84915.log.gz 2024-09-14T22:46:46.164 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.154324.log 2024-09-14T22:46:46.165 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86801.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105280.log 2024-09-14T22:46:46.165 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86801.log.gz 2024-09-14T22:46:46.165 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.154324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.154324.log.gz 2024-09-14T22:46:46.165 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111334.log 2024-09-14T22:46:46.166 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105280.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105280.log.gz 2024-09-14T22:46:46.166 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137003.log 2024-09-14T22:46:46.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111334.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.111334.log.gz 2024-09-14T22:46:46.167 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.140103.log 2024-09-14T22:46:46.167 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137003.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137003.log.gz 2024-09-14T22:46:46.167 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153774.log 2024-09-14T22:46:46.168 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.140103.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.140103.log.gz 2024-09-14T22:46:46.168 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.120007.log 2024-09-14T22:46:46.169 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153774.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153774.log.gz 2024-09-14T22:46:46.169 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44499.log 2024-09-14T22:46:46.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.120007.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88523.log 2024-09-14T22:46:46.170 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.120007.log.gz 2024-09-14T22:46:46.170 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44499.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44499.log.gz 2024-09-14T22:46:46.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72406.log 2024-09-14T22:46:46.171 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88523.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88523.log.gz 2024-09-14T22:46:46.171 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60793.log 2024-09-14T22:46:46.172 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72406.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72406.log.gz 2024-09-14T22:46:46.172 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92012.log 2024-09-14T22:46:46.173 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60793.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60793.log.gz 2024-09-14T22:46:46.173 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110747.log 2024-09-14T22:46:46.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92012.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92012.log.gz 2024-09-14T22:46:46.174 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89109.log 2024-09-14T22:46:46.174 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110747.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110747.log.gz 2024-09-14T22:46:46.174 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133380.log 2024-09-14T22:46:46.175 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89109.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89109.log.gz 2024-09-14T22:46:46.175 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143880.log 2024-09-14T22:46:46.176 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133380.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133380.log.gz 2024-09-14T22:46:46.176 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100408.log 2024-09-14T22:46:46.177 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143880.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143880.log.gz 2024-09-14T22:46:46.177 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137423.log 2024-09-14T22:46:46.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100408.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100408.log.gz 2024-09-14T22:46:46.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36521.log 2024-09-14T22:46:46.178 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137423.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137423.log.gz 2024-09-14T22:46:46.178 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53037.log 2024-09-14T22:46:46.179 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36521.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36521.log.gz 2024-09-14T22:46:46.179 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135743.log 2024-09-14T22:46:46.180 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53037.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53037.log.gz 2024-09-14T22:46:46.180 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65662.log 2024-09-14T22:46:46.181 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135743.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.135743.log.gz -- 2024-09-14T22:46:46.181 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.125972.log 2024-09-14T22:46:46.182 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65662.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65662.log.gz 2024-09-14T22:46:46.182 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61833.log 2024-09-14T22:46:46.183 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125972.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143511.log 2024-09-14T22:46:46.183 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125972.log.gz 2024-09-14T22:46:46.183 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61833.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.61833.log.gz 2024-09-14T22:46:46.184 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37473.log 2024-09-14T22:46:46.184 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143511.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.60569.log -- replaced with /var/log/ceph/cluster1-client.mirror.143511.log.gz 2024-09-14T22:46:46.184 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:46.185 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37473.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37473.log.gzgzip 2024-09-14T22:46:46.185 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36848.log 2024-09-14T22:46:46.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.60569.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.60569.log.gz 2024-09-14T22:46:46.186 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123663.log 2024-09-14T22:46:46.186 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36848.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.mirror.36848.log.gz -- 2024-09-14T22:46:46.187 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.admin.153915.log 2024-09-14T22:46:46.187 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123663.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123663.log.gz 2024-09-14T22:46:46.187 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110169.log 2024-09-14T22:46:46.188 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153915.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153915.log.gz 2024-09-14T22:46:46.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132333.log 2024-09-14T22:46:46.189 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110169.log.gz 2024-09-14T22:46:46.189 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144169.log 2024-09-14T22:46:46.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132333.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132333.log.gz 2024-09-14T22:46:46.190 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44422.log 2024-09-14T22:46:46.190 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144169.log.gz 2024-09-14T22:46:46.190 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78469.log 2024-09-14T22:46:46.191 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44422.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44422.log.gz 2024-09-14T22:46:46.191 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42906.log 2024-09-14T22:46:46.192 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78469.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78469.log.gz 2024-09-14T22:46:46.192 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56552.log 2024-09-14T22:46:46.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42906.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42906.log.gz 2024-09-14T22:46:46.193 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40697.log 2024-09-14T22:46:46.193 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56552.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.56552.log.gz 2024-09-14T22:46:46.194 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147090.log 2024-09-14T22:46:46.194 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40697.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40697.log.gz 2024-09-14T22:46:46.194 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115080.log 2024-09-14T22:46:46.195 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147090.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147090.log.gz 2024-09-14T22:46:46.195 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57923.log 2024-09-14T22:46:46.196 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115080.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115080.log.gz 2024-09-14T22:46:46.196 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.131284.log 2024-09-14T22:46:46.197 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57923.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57923.log.gz 2024-09-14T22:46:46.197 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107100.log 2024-09-14T22:46:46.197 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.131284.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.131284.log.gz 2024-09-14T22:46:46.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72963.log 2024-09-14T22:46:46.198 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107100.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107100.log.gz 2024-09-14T22:46:46.198 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49759.log 2024-09-14T22:46:46.199 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72963.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72963.log.gz 2024-09-14T22:46:46.199 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69005.log 2024-09-14T22:46:46.200 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49759.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49759.log.gz 2024-09-14T22:46:46.200 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138203.log 2024-09-14T22:46:46.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69005.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69005.log.gz 2024-09-14T22:46:46.201 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115142.log 2024-09-14T22:46:46.201 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138203.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138203.log.gz 2024-09-14T22:46:46.202 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98136.log 2024-09-14T22:46:46.202 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115142.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115142.log.gz 2024-09-14T22:46:46.202 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106680.log 2024-09-14T22:46:46.203 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98136.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98136.log.gz 2024-09-14T22:46:46.203 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80836.log 2024-09-14T22:46:46.204 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106680.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106680.log.gz 2024-09-14T22:46:46.204 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54256.log 2024-09-14T22:46:46.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80836.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80836.log.gz 2024-09-14T22:46:46.205 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.56704.log 2024-09-14T22:46:46.205 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54256.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54256.log.gz 2024-09-14T22:46:46.205 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.129815.log 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.56704.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.56704.log.gz 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39934.log 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.129815.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.129815.log.gz 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42036.log 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39934.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39934.log.gz 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135262.log 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42036.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42036.log.gz 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73030.log 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135262.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135262.log.gz 2024-09-14T22:46:46.210 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63538.log 2024-09-14T22:46:46.211 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73030.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73030.log.gz 2024-09-14T22:46:46.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150766.log 2024-09-14T22:46:46.211 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63538.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63538.log.gz 2024-09-14T22:46:46.211 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88295.log 2024-09-14T22:46:46.212 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150766.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102211.log 2024-09-14T22:46:46.212 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150766.log.gz 2024-09-14T22:46:46.212 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88295.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88295.log.gz 2024-09-14T22:46:46.213 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.58180.log 2024-09-14T22:46:46.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102211.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102211.log.gz 2024-09-14T22:46:46.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147550.log 2024-09-14T22:46:46.214 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.58180.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.58180.log.gz 2024-09-14T22:46:46.214 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.67226.log 2024-09-14T22:46:46.215 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147550.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147550.log.gz 2024-09-14T22:46:46.215 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64421.log 2024-09-14T22:46:46.216 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.67226.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.67226.log.gz 2024-09-14T22:46:46.216 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49655.log 2024-09-14T22:46:46.217 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64421.log.gz 2024-09-14T22:46:46.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37576.log 2024-09-14T22:46:46.217 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49655.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49655.log.gz 2024-09-14T22:46:46.217 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.117482.log 2024-09-14T22:46:46.218 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37576.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37576.log.gz 2024-09-14T22:46:46.218 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136375.log 2024-09-14T22:46:46.219 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.117482.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49424.log 2024-09-14T22:46:46.219 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.117482.log.gz 2024-09-14T22:46:46.220 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136375.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136375.log.gz 2024-09-14T22:46:46.220 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74394.log 2024-09-14T22:46:46.221 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49424.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49424.log.gz 2024-09-14T22:46:46.221 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90735.log 2024-09-14T22:46:46.221 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74394.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74394.log.gz 2024-09-14T22:46:46.221 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124421.log 2024-09-14T22:46:46.222 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90735.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90735.log.gz 2024-09-14T22:46:46.222 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150476.log 2024-09-14T22:46:46.223 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124421.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124421.log.gz 2024-09-14T22:46:46.223 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.140454.log 2024-09-14T22:46:46.224 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150476.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150476.log.gz 2024-09-14T22:46:46.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100364.log 2024-09-14T22:46:46.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.140454.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.140454.log.gz 2024-09-14T22:46:46.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.61986.log 2024-09-14T22:46:46.225 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100364.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100364.log.gz 2024-09-14T22:46:46.225 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97946.log 2024-09-14T22:46:46.226 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.61986.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.61986.log.gz 2024-09-14T22:46:46.226 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.133052.log 2024-09-14T22:46:46.227 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97946.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97946.log.gz 2024-09-14T22:46:46.227 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73840.log 2024-09-14T22:46:46.228 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.133052.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.133052.log.gz 2024-09-14T22:46:46.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134443.log 2024-09-14T22:46:46.229 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73840.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73840.log.gz 2024-09-14T22:46:46.229 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.128898.log 2024-09-14T22:46:46.229 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134443.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134443.log.gz 2024-09-14T22:46:46.230 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111127.log 2024-09-14T22:46:46.230 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.128898.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.128898.log.gz 2024-09-14T22:46:46.230 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51691.log 2024-09-14T22:46:46.231 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111127.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111127.log.gz 2024-09-14T22:46:46.231 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136500.log 2024-09-14T22:46:46.232 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51691.log.gz 2024-09-14T22:46:46.232 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.43346.log 2024-09-14T22:46:46.232 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136500.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136500.log.gz 2024-09-14T22:46:46.233 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58563.log 2024-09-14T22:46:46.234 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85352.log 2024-09-14T22:46:46.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.43346.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.43346.log.gz 2024-09-14T22:46:46.234 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58563.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58563.log.gz 2024-09-14T22:46:46.234 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66966.log 2024-09-14T22:46:46.235 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85352.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85352.log.gz 2024-09-14T22:46:46.235 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112912.log 2024-09-14T22:46:46.236 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66966.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.66966.log.gz 2024-09-14T22:46:46.236 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.151101.log 2024-09-14T22:46:46.237 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112912.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112912.log.gz 2024-09-14T22:46:46.237 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92447.log 2024-09-14T22:46:46.237 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151101.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151101.log.gz 2024-09-14T22:46:46.238 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53709.log 2024-09-14T22:46:46.238 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92447.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92447.log.gz 2024-09-14T22:46:46.238 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108862.log 2024-09-14T22:46:46.239 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53709.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53709.log.gz 2024-09-14T22:46:46.239 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104816.log 2024-09-14T22:46:46.240 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108862.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92232.log 2024-09-14T22:46:46.240 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108862.log.gz 2024-09-14T22:46:46.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104816.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104816.log.gz 2024-09-14T22:46:46.241 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34111.log 2024-09-14T22:46:46.241 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92232.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.92232.log.gz 2024-09-14T22:46:46.242 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40834.log 2024-09-14T22:46:46.242 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34111.log: gzip 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34111.log.gz 2024-09-14T22:46:46.242 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster2-client.admin.29306.log 2024-09-14T22:46:46.243 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40834.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40834.log.gz 2024-09-14T22:46:46.243 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.80608.log 2024-09-14T22:46:46.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.29306.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.29306.log.gz 2024-09-14T22:46:46.244 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77758.log 2024-09-14T22:46:46.244 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.80608.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.80608.log.gz 2024-09-14T22:46:46.245 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117318.log 2024-09-14T22:46:46.245 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77758.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77758.log.gz 2024-09-14T22:46:46.245 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.72692.log 2024-09-14T22:46:46.246 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117318.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117318.log.gz 2024-09-14T22:46:46.246 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83761.log 2024-09-14T22:46:46.247 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.72692.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.72692.log.gz 2024-09-14T22:46:46.247 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40837.log 2024-09-14T22:46:46.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83761.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83761.log.gz 2024-09-14T22:46:46.248 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.144171.log 2024-09-14T22:46:46.248 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40837.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40837.log.gz 2024-09-14T22:46:46.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110093.log 2024-09-14T22:46:46.249 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.144171.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.144171.log.gz 2024-09-14T22:46:46.249 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42429.log 2024-09-14T22:46:46.250 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110093.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110093.log.gz 2024-09-14T22:46:46.250 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119708.log 2024-09-14T22:46:46.251 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42429.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42429.log.gz 2024-09-14T22:46:46.251 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143987.log 2024-09-14T22:46:46.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119708.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119708.log.gz 2024-09-14T22:46:46.252 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50860.log 2024-09-14T22:46:46.252 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143987.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108820.log 2024-09-14T22:46:46.253 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143987.log.gz 2024-09-14T22:46:46.253 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50860.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50860.log.gz 2024-09-14T22:46:46.253 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125683.log 2024-09-14T22:46:46.254 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108820.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108820.log.gz 2024-09-14T22:46:46.254 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138274.log 2024-09-14T22:46:46.255 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125683.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125683.log.gz 2024-09-14T22:46:46.255 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.54612.log 2024-09-14T22:46:46.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138274.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138274.log.gz 2024-09-14T22:46:46.256 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.38169.log 2024-09-14T22:46:46.256 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.54612.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.54612.log.gz 2024-09-14T22:46:46.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152798.log 2024-09-14T22:46:46.257 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.38169.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.38169.log.gz 2024-09-14T22:46:46.257 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135390.log 2024-09-14T22:46:46.258 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152798.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57212.log 2024-09-14T22:46:46.258 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152798.log.gz 2024-09-14T22:46:46.259 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135390.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135390.log.gz 2024-09-14T22:46:46.259 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.59456.log 2024-09-14T22:46:46.259 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57212.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57212.log.gz 2024-09-14T22:46:46.260 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125008.log 2024-09-14T22:46:46.260 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59456.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59456.log.gz 2024-09-14T22:46:46.260 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47021.log 2024-09-14T22:46:46.261 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125008.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125008.log.gz 2024-09-14T22:46:46.261 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50977.log 2024-09-14T22:46:46.262 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47021.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47021.log.gz 2024-09-14T22:46:46.262 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111378.log 2024-09-14T22:46:46.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50977.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50977.log.gz 2024-09-14T22:46:46.263 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115287.log 2024-09-14T22:46:46.263 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111378.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111378.log.gz 2024-09-14T22:46:46.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151881.log 2024-09-14T22:46:46.264 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115287.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115287.log.gz 2024-09-14T22:46:46.264 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112195.log 2024-09-14T22:46:46.265 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151881.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151881.log.gz 2024-09-14T22:46:46.265 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138239.log 2024-09-14T22:46:46.266 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112195.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112195.log.gz 2024-09-14T22:46:46.266 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147653.log 2024-09-14T22:46:46.267 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138239.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.138239.log.gz 2024-09-14T22:46:46.267 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.110726.log 2024-09-14T22:46:46.268 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147653.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.127959.log 2024-09-14T22:46:46.268 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147653.log.gz 2024-09-14T22:46:46.268 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110726.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110726.log.gz 2024-09-14T22:46:46.268 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.107386.log 2024-09-14T22:46:46.269 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.127959.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.127959.log.gz 2024-09-14T22:46:46.269 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75318.log 2024-09-14T22:46:46.270 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.107386.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.107386.log.gz 2024-09-14T22:46:46.270 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76784.log 2024-09-14T22:46:46.271 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75318.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75318.log.gz 2024-09-14T22:46:46.271 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132289.log 2024-09-14T22:46:46.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76784.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76784.log.gz 2024-09-14T22:46:46.272 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48032.log 2024-09-14T22:46:46.272 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132289.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132289.log.gz 2024-09-14T22:46:46.272 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.95557.log 2024-09-14T22:46:46.273 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48032.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48032.log.gz 2024-09-14T22:46:46.273 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.116740.log 2024-09-14T22:46:46.274 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95557.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95557.log.gz 2024-09-14T22:46:46.274 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.56089.log 2024-09-14T22:46:46.275 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.116740.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.admin.116740.log.gz -- 2024-09-14T22:46:46.275 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster2-client.mirror.70487.log 2024-09-14T22:46:46.276 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.56089.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.56089.log.gz 2024-09-14T22:46:46.276 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.105350.log 2024-09-14T22:46:46.276 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.70487.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.70487.log.gz 2024-09-14T22:46:46.276 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98031.log 2024-09-14T22:46:46.277 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.105350.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.105350.log.gz 2024-09-14T22:46:46.277 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.96604.log 2024-09-14T22:46:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98031.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98031.log.gz 2024-09-14T22:46:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.35289.log 2024-09-14T22:46:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.96604.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.96604.log.gz 2024-09-14T22:46:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.85374.log 2024-09-14T22:46:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.35289.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.35289.log.gz 2024-09-14T22:46:46.280 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.152128.log 2024-09-14T22:46:46.280 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.85374.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.85374.log.gz 2024-09-14T22:46:46.280 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.116966.log 2024-09-14T22:46:46.281 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.152128.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.152128.log.gz 2024-09-14T22:46:46.281 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153179.log 2024-09-14T22:46:46.282 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.116966.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.116966.log.gz 2024-09-14T22:46:46.282 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.106794.log 2024-09-14T22:46:46.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153179.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153179.log.gz 2024-09-14T22:46:46.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119185.log 2024-09-14T22:46:46.283 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106794.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106794.log.gz 2024-09-14T22:46:46.283 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137760.log 2024-09-14T22:46:46.284 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119185.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119185.log.gz 2024-09-14T22:46:46.284 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66543.log 2024-09-14T22:46:46.285 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137760.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137760.log.gz 2024-09-14T22:46:46.285 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.119709.log 2024-09-14T22:46:46.286 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66543.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66543.log.gz 2024-09-14T22:46:46.286 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65093.log 2024-09-14T22:46:46.286 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.119709.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.119709.log.gz 2024-09-14T22:46:46.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40354.log 2024-09-14T22:46:46.287 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65093.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65093.log.gz 2024-09-14T22:46:46.287 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82550.log 2024-09-14T22:46:46.288 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40354.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.40354.log.gz --verbose 2024-09-14T22:46:46.288 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.admin.55872.log 2024-09-14T22:46:46.289 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82550.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82550.log.gz 2024-09-14T22:46:46.289 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77119.log 2024-09-14T22:46:46.290 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55872.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55872.log.gz 2024-09-14T22:46:46.290 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132606.log 2024-09-14T22:46:46.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77119.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77119.log.gz 2024-09-14T22:46:46.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113919.log 2024-09-14T22:46:46.291 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132606.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132606.log.gz 2024-09-14T22:46:46.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149904.log 2024-09-14T22:46:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113919.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113919.log.gz 2024-09-14T22:46:46.292 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151256.log 2024-09-14T22:46:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149904.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149904.log.gz 2024-09-14T22:46:46.293 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113544.log 2024-09-14T22:46:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151256.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151256.log.gz 2024-09-14T22:46:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.91484.log 2024-09-14T22:46:46.294 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113544.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.113544.log.gz /var/log/ceph/cluster1-client.mirror.145410.log 2024-09-14T22:46:46.294 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.91484.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.91484.log.gz 2024-09-14T22:46:46.295 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135259.log 2024-09-14T22:46:46.296 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145410.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145410.log.gz 2024-09-14T22:46:46.296 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74098.log 2024-09-14T22:46:46.297 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135259.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135259.log.gz 2024-09-14T22:46:46.297 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.136331.log 2024-09-14T22:46:46.298 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74098.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74098.log.gz 2024-09-14T22:46:46.298 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.90609.log 2024-09-14T22:46:46.299 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.136331.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150764.log 2024-09-14T22:46:46.299 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.136331.log.gz 2024-09-14T22:46:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.90609.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.90609.log.gz 2024-09-14T22:46:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87853.log 2024-09-14T22:46:46.300 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150764.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87518.log 2024-09-14T22:46:46.300 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150764.log.gz 2024-09-14T22:46:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87853.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87853.log.gz 2024-09-14T22:46:46.301 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134157.log 2024-09-14T22:46:46.302 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87518.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.129068.log 0.0% 2024-09-14T22:46:46.302 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.mirror.87518.log.gz 2024-09-14T22:46:46.303 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134157.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134157.log.gz 2024-09-14T22:46:46.303 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149610.log 2024-09-14T22:46:46.303 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.129068.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.129068.log.gz 2024-09-14T22:46:46.304 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.80740.log 2024-09-14T22:46:46.304 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149610.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.95969.log 2024-09-14T22:46:46.304 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149610.log.gz 2024-09-14T22:46:46.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.80740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.80740.log.gzgzip 2024-09-14T22:46:46.305 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.139221.log 2024-09-14T22:46:46.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.95969.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/cluster1-client.admin.95969.log.gz -- 2024-09-14T22:46:46.306 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/cluster1-client.mirror.123057.log 2024-09-14T22:46:46.307 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139221.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139221.log.gz 2024-09-14T22:46:46.307 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.60999.log 2024-09-14T22:46:46.308 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123057.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83573.log 2024-09-14T22:46:46.308 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123057.log.gz 2024-09-14T22:46:46.309 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.60999.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.60999.log.gz 2024-09-14T22:46:46.309 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.131484.log 2024-09-14T22:46:46.309 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83573.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83573.log.gz 2024-09-14T22:46:46.310 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.152913.log 2024-09-14T22:46:46.310 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100962.log 2024-09-14T22:46:46.311 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.131484.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.131484.log.gz 2024-09-14T22:46:46.311 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.152913.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.152913.log.gz 2024-09-14T22:46:46.311 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.139417.log 2024-09-14T22:46:46.312 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100962.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100962.log.gz 2024-09-14T22:46:46.312 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76009.log 2024-09-14T22:46:46.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.139417.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.139417.log.gz 2024-09-14T22:46:46.313 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134261.log 2024-09-14T22:46:46.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76009.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.130732.log 2024-09-14T22:46:46.314 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76009.log.gz 2024-09-14T22:46:46.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134261.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109432.log 2024-09-14T22:46:46.314 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134261.log.gz 2024-09-14T22:46:46.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.130732.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.130732.log.gz 2024-09-14T22:46:46.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36483.log 2024-09-14T22:46:46.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109432.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109432.log.gz 2024-09-14T22:46:46.316 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73740.log 2024-09-14T22:46:46.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36483.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36483.log.gz 2024-09-14T22:46:46.317 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.48756.log 2024-09-14T22:46:46.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73740.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73740.log.gz 2024-09-14T22:46:46.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125428.log 2024-09-14T22:46:46.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.48756.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.48756.log.gz 2024-09-14T22:46:46.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124210.log 2024-09-14T22:46:46.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125428.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125428.log.gz 2024-09-14T22:46:46.320 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68843.log 2024-09-14T22:46:46.320 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124210.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/cluster1-client.mirror.124210.log.gz /var/log/ceph/cluster1-client.mirror.143336.log 2024-09-14T22:46:46.320 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:46:46.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68843.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40477.log 2024-09-14T22:46:46.321 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68843.log.gz 2024-09-14T22:46:46.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143336.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143336.log.gz 2024-09-14T22:46:46.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102577.log 2024-09-14T22:46:46.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40477.log: gzip 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40477.log.gz -5 2024-09-14T22:46:46.323 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/cluster1-client.mirror.59393.log 2024-09-14T22:46:46.323 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102577.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.102577.log.gz 2024-09-14T22:46:46.324 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98283.log 2024-09-14T22:46:46.324 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.59393.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.93568.log 2024-09-14T22:46:46.324 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.59393.log.gz 2024-09-14T22:46:46.325 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98283.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98283.log.gz 2024-09-14T22:46:46.325 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.56511.log 2024-09-14T22:46:46.326 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.93568.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.93568.log.gz 2024-09-14T22:46:46.326 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149691.log 2024-09-14T22:46:46.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.56511.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.56511.log.gz 2024-09-14T22:46:46.327 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34318.log 2024-09-14T22:46:46.327 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149691.log.gz 2024-09-14T22:46:46.328 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63582.log 2024-09-14T22:46:46.328 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34318.log: 0.0%gzip -- replaced with /var/log/ceph/cluster2-client.admin.34318.log.gz 2024-09-14T22:46:46.328 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.admin.48291.log 2024-09-14T22:46:46.329 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63582.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.63582.log.gz 2024-09-14T22:46:46.329 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89239.log 2024-09-14T22:46:46.330 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.48291.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.48291.log.gz 2024-09-14T22:46:46.330 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.143094.log 2024-09-14T22:46:46.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89239.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89239.log.gz 2024-09-14T22:46:46.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.102296.log 2024-09-14T22:46:46.331 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.143094.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.143094.log.gz 2024-09-14T22:46:46.331 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.94535.log 2024-09-14T22:46:46.332 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.102296.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.mirror.102296.log.gz --verbose 2024-09-14T22:46:46.332 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.106964.log 2024-09-14T22:46:46.333 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.94535.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.94535.log.gz 2024-09-14T22:46:46.333 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.63159.log 2024-09-14T22:46:46.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.106964.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.106964.log.gz 2024-09-14T22:46:46.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88081.log 2024-09-14T22:46:46.334 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.63159.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.63159.log.gz 2024-09-14T22:46:46.334 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115792.log 2024-09-14T22:46:46.335 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88081.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154869.log 2024-09-14T22:46:46.335 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88081.log.gz 2024-09-14T22:46:46.336 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115792.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115792.log.gz 2024-09-14T22:46:46.336 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90287.log 2024-09-14T22:46:46.337 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154869.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.76871.log 2024-09-14T22:46:46.337 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154869.log.gz 2024-09-14T22:46:46.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90287.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90287.log.gz 2024-09-14T22:46:46.338 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134654.log 2024-09-14T22:46:46.338 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.76871.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.76871.log.gz 2024-09-14T22:46:46.339 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93542.log 2024-09-14T22:46:46.339 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134654.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66039.log 2024-09-14T22:46:46.339 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134654.log.gz 2024-09-14T22:46:46.340 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93542.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93542.log.gz 2024-09-14T22:46:46.340 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125783.log 2024-09-14T22:46:46.341 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66039.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66039.log.gz 2024-09-14T22:46:46.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103990.log 2024-09-14T22:46:46.342 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125783.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125783.log.gz 2024-09-14T22:46:46.342 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46289.log 2024-09-14T22:46:46.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103990.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.35490.log 2024-09-14T22:46:46.343 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103990.log.gz 2024-09-14T22:46:46.343 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46289.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46289.log.gz 2024-09-14T22:46:46.343 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.104072.log 2024-09-14T22:46:46.344 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.35490.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.35490.log.gz 2024-09-14T22:46:46.344 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132440.log 2024-09-14T22:46:46.345 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.104072.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.104072.log.gz 2024-09-14T22:46:46.345 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.117661.log 2024-09-14T22:46:46.346 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132440.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132440.log.gz 2024-09-14T22:46:46.346 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.142698.log 2024-09-14T22:46:46.347 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.117661.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.117661.log.gz 2024-09-14T22:46:46.347 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62320.log 2024-09-14T22:46:46.347 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.142698.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.82342.log 2024-09-14T22:46:46.348 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.142698.log.gz 2024-09-14T22:46:46.348 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62320.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62320.log.gz 2024-09-14T22:46:46.348 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66847.log 2024-09-14T22:46:46.349 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.82342.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.82342.log.gz 2024-09-14T22:46:46.349 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55780.log 2024-09-14T22:46:46.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66847.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43455.log 2024-09-14T22:46:46.350 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66847.log.gz 2024-09-14T22:46:46.350 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55780.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.55780.log.gz 2024-09-14T22:46:46.351 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77583.log 2024-09-14T22:46:46.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43455.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43455.log.gz 2024-09-14T22:46:46.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.92622.log 2024-09-14T22:46:46.352 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77583.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77583.log.gz 2024-09-14T22:46:46.352 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.138460.log 2024-09-14T22:46:46.353 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.92622.log: gzip 0.0% -5 -- replaced with /var/log/ceph/cluster1-client.admin.92622.log.gz --verbose 2024-09-14T22:46:46.353 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.95356.log 2024-09-14T22:46:46.354 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.138460.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123896.log 2024-09-14T22:46:46.354 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.138460.log.gz 2024-09-14T22:46:46.355 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.95356.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.95356.log.gz 2024-09-14T22:46:46.355 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52111.log 2024-09-14T22:46:46.355 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123896.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123896.log.gz 2024-09-14T22:46:46.356 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.87517.log 2024-09-14T22:46:46.357 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52111.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52111.log.gz 2024-09-14T22:46:46.357 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74222.log 2024-09-14T22:46:46.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.87517.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.87517.log.gz 2024-09-14T22:46:46.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.34445.log 2024-09-14T22:46:46.358 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74222.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74222.log.gz 2024-09-14T22:46:46.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129903.log 2024-09-14T22:46:46.359 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.34445.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53415.log 2024-09-14T22:46:46.359 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.34445.log.gz 2024-09-14T22:46:46.360 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129903.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.100487.log 2024-09-14T22:46:46.360 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129903.log.gz 2024-09-14T22:46:46.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53415.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.69169.log 2024-09-14T22:46:46.361 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53415.log.gz 2024-09-14T22:46:46.361 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.100487.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.100487.log.gz 2024-09-14T22:46:46.362 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.94281.log 2024-09-14T22:46:46.362 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.69169.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89282.log 2024-09-14T22:46:46.362 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.69169.log.gz 2024-09-14T22:46:46.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.94281.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53457.log 2024-09-14T22:46:46.363 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.94281.log.gz 2024-09-14T22:46:46.363 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89282.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43598.log 2024-09-14T22:46:46.364 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89282.log.gz 2024-09-14T22:46:46.364 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53457.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53457.log.gz 2024-09-14T22:46:46.364 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.128614.log 2024-09-14T22:46:46.365 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43598.log: gzip -5 --verbose -- 0.0% /var/log/ceph/cluster1-client.admin.58382.log 2024-09-14T22:46:46.365 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.43598.log.gz 2024-09-14T22:46:46.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.128614.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.143623.log 2024-09-14T22:46:46.366 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.128614.log.gz 2024-09-14T22:46:46.366 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.58382.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42455.log 0.0% 2024-09-14T22:46:46.367 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/cluster1-client.admin.58382.log.gz 2024-09-14T22:46:46.367 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.143623.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.143623.log.gz 2024-09-14T22:46:46.367 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.98387.log 2024-09-14T22:46:46.368 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42455.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42455.log.gz 2024-09-14T22:46:46.368 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83047.log 2024-09-14T22:46:46.369 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.98387.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.98387.log.gz 2024-09-14T22:46:46.369 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52407.log 2024-09-14T22:46:46.370 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83047.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83047.log.gz 2024-09-14T22:46:46.370 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.58107.log 2024-09-14T22:46:46.371 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52407.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.74600.log 2024-09-14T22:46:46.371 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52407.log.gz 2024-09-14T22:46:46.372 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.58107.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.58107.log.gz 2024-09-14T22:46:46.372 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108148.log 2024-09-14T22:46:46.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.74600.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.74600.log.gz 2024-09-14T22:46:46.373 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.104493.log 2024-09-14T22:46:46.373 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108148.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108148.log.gz 2024-09-14T22:46:46.374 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.93861.log 2024-09-14T22:46:46.374 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.104493.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.104493.log.gz 2024-09-14T22:46:46.374 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.103041.log 2024-09-14T22:46:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.93861.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.93861.log.gz 2024-09-14T22:46:46.375 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.147592.log 2024-09-14T22:46:46.376 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.103041.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78193.log 2024-09-14T22:46:46.377 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.103041.log.gz 2024-09-14T22:46:46.377 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.147592.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.147592.log.gz 2024-09-14T22:46:46.377 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69848.log 2024-09-14T22:46:46.378 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78193.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78193.log.gz 2024-09-14T22:46:46.378 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111822.log 2024-09-14T22:46:46.379 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69848.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69848.log.gz 2024-09-14T22:46:46.379 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.49885.log 2024-09-14T22:46:46.380 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111822.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111822.log.gz 2024-09-14T22:46:46.380 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.115794.log 2024-09-14T22:46:46.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.49885.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.49885.log.gz 2024-09-14T22:46:46.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.75902.log 2024-09-14T22:46:46.381 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.115794.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.115794.log.gz 2024-09-14T22:46:46.381 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132648.log 2024-09-14T22:46:46.382 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.75902.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.75902.log.gz 2024-09-14T22:46:46.382 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.47047.log 2024-09-14T22:46:46.383 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132648.log.gz 2024-09-14T22:46:46.383 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65566.log 2024-09-14T22:46:46.384 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.47047.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.47047.log.gz 2024-09-14T22:46:46.384 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.55050.log 2024-09-14T22:46:46.385 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65566.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64528.log 2024-09-14T22:46:46.385 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65566.log.gz 2024-09-14T22:46:46.386 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.55050.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.55050.log.gz 2024-09-14T22:46:46.386 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.89156.log 2024-09-14T22:46:46.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64528.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64528.log.gz 2024-09-14T22:46:46.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.114090.log 2024-09-14T22:46:46.387 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.89156.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.89156.log.gz 2024-09-14T22:46:46.387 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.109465.log 2024-09-14T22:46:46.388 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.114090.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.114090.log.gz 2024-09-14T22:46:46.388 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.79068.log 2024-09-14T22:46:46.389 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.109465.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.109465.log.gz 2024-09-14T22:46:46.389 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.97024.log 2024-09-14T22:46:46.390 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.79068.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.121184.log 2024-09-14T22:46:46.390 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.79068.log.gz 2024-09-14T22:46:46.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.97024.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.97024.log.gz 2024-09-14T22:46:46.391 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145702.log 2024-09-14T22:46:46.391 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.121184.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.121184.log.gz 2024-09-14T22:46:46.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39766.log 2024-09-14T22:46:46.392 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145702.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145702.log.gz 2024-09-14T22:46:46.392 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.80723.log 2024-09-14T22:46:46.393 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39766.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39766.log.gz 2024-09-14T22:46:46.393 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.134549.log 2024-09-14T22:46:46.394 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.80723.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.80723.log.gz 2024-09-14T22:46:46.394 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64298.log 2024-09-14T22:46:46.395 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.134549.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.36046.log 2024-09-14T22:46:46.395 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.134549.log.gz 2024-09-14T22:46:46.396 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64298.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64298.log.gz 2024-09-14T22:46:46.396 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113226.log 2024-09-14T22:46:46.396 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.36046.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.36046.log.gz 2024-09-14T22:46:46.397 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.125849.log 2024-09-14T22:46:46.397 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113226.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113226.log.gz 2024-09-14T22:46:46.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110644.log 2024-09-14T22:46:46.398 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.125849.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.125849.log.gz 2024-09-14T22:46:46.398 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.77038.log 2024-09-14T22:46:46.399 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110644.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110644.log.gz 2024-09-14T22:46:46.399 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.108904.log 2024-09-14T22:46:46.400 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.77038.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.88691.log 2024-09-14T22:46:46.400 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.77038.log.gz 2024-09-14T22:46:46.401 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.108904.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.108904.log.gz 2024-09-14T22:46:46.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.37324.log 2024-09-14T22:46:46.402 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.88691.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.88691.log.gz 2024-09-14T22:46:46.402 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78509.log 2024-09-14T22:46:46.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.37324.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.37324.log.gz 2024-09-14T22:46:46.403 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145201.log 2024-09-14T22:46:46.403 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78509.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78509.log.gz 2024-09-14T22:46:46.404 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.82041.log 2024-09-14T22:46:46.404 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145201.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145661.log 2024-09-14T22:46:46.404 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145201.log.gz 2024-09-14T22:46:46.405 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.82041.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.82041.log.gz 2024-09-14T22:46:46.405 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.55649.log 2024-09-14T22:46:46.406 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145661.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145661.log.gz 2024-09-14T22:46:46.406 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.78297.log 2024-09-14T22:46:46.407 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.55649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.55649.log.gz 2024-09-14T22:46:46.407 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64109.log 2024-09-14T22:46:46.408 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.78297.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.78297.log.gz 2024-09-14T22:46:46.408 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42589.log 2024-09-14T22:46:46.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64109.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.69966.log 2024-09-14T22:46:46.409 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64109.log.gz 2024-09-14T22:46:46.409 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42589.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42589.log.gz 2024-09-14T22:46:46.410 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.123897.log 2024-09-14T22:46:46.410 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.69966.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.39350.log 2024-09-14T22:46:46.410 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.69966.log.gz 2024-09-14T22:46:46.411 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.123897.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.123897.log.gz 2024-09-14T22:46:46.411 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.149732.log 2024-09-14T22:46:46.412 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.39350.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.39350.log.gz 2024-09-14T22:46:46.412 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.46497.log 2024-09-14T22:46:46.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.149732.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.149732.log.gz 2024-09-14T22:46:46.413 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.42285.log 2024-09-14T22:46:46.413 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.46497.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.46497.log.gz 2024-09-14T22:46:46.414 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.45071.log 2024-09-14T22:46:46.414 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.42285.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.52575.log 2024-09-14T22:46:46.415 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.42285.log.gz 2024-09-14T22:46:46.415 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.45071.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.45071.log.gz 2024-09-14T22:46:46.415 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.46175.log 2024-09-14T22:46:46.416 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.52575.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.52575.log.gz 2024-09-14T22:46:46.416 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.51229.log 2024-09-14T22:46:46.417 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.46175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.46175.log.gz 2024-09-14T22:46:46.417 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.129534.log 2024-09-14T22:46:46.418 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.51229.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.51229.log.gz 2024-09-14T22:46:46.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83083.log 2024-09-14T22:46:46.419 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.129534.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.129534.log.gz 2024-09-14T22:46:46.419 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.90635.log 2024-09-14T22:46:46.420 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83083.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83083.log.gz 2024-09-14T22:46:46.420 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.0.34689.log 2024-09-14T22:46:46.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.90635.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.90635.log.gz 2024-09-14T22:46:46.421 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.148895.log 2024-09-14T22:46:46.421 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.0.34689.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.139816.log 2024-09-14T22:46:46.422 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.148895.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.148895.log.gz 2024-09-14T22:46:46.422 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.146903.log 2024-09-14T22:46:46.423 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.139816.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.139816.log.gz 2024-09-14T22:46:46.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.86927.log 2024-09-14T22:46:46.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.146903.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.146903.log.gz 2024-09-14T22:46:46.424 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53330.log 2024-09-14T22:46:46.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.86927.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.86927.log.gz 2024-09-14T22:46:46.425 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.83175.log 2024-09-14T22:46:46.425 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53330.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53330.log.gz 2024-09-14T22:46:46.426 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124841.log 2024-09-14T22:46:46.427 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.83175.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.83175.log.gz 2024-09-14T22:46:46.427 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65413.log 2024-09-14T22:46:46.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124841.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110514.log 2024-09-14T22:46:46.428 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124841.log.gz 2024-09-14T22:46:46.428 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65413.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65413.log.gz 2024-09-14T22:46:46.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.40550.log 2024-09-14T22:46:46.429 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110514.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110514.log.gz 2024-09-14T22:46:46.429 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.64819.log 2024-09-14T22:46:46.430 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.40550.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151878.log 2024-09-14T22:46:46.430 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.40550.log.gz 2024-09-14T22:46:46.431 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.64819.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.64819.log.gz 2024-09-14T22:46:46.431 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.43286.log 2024-09-14T22:46:46.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151878.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151878.log.gz 2024-09-14T22:46:46.432 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66229.log 2024-09-14T22:46:46.432 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.43286.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113670.log 2024-09-14T22:46:46.433 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.43286.log.gz 2024-09-14T22:46:46.433 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66229.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66229.log.gz 2024-09-14T22:46:46.433 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.154953.log 2024-09-14T22:46:46.434 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113670.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.127238.log 2024-09-14T22:46:46.434 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113670.log.gz 2024-09-14T22:46:46.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.154953.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.154953.log.gz 2024-09-14T22:46:46.435 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.57910.log 2024-09-14T22:46:46.435 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.127238.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.127238.log.gz 2024-09-14T22:46:46.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.73113.log 2024-09-14T22:46:46.436 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.57910.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.57910.log.gz 2024-09-14T22:46:46.436 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.124527.log 2024-09-14T22:46:46.437 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.73113.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.153073.log 2024-09-14T22:46:46.437 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.73113.log.gz 2024-09-14T22:46:46.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.124527.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.124527.log.gz 2024-09-14T22:46:46.438 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45956.log 2024-09-14T22:46:46.438 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.153073.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62153.log 2024-09-14T22:46:46.438 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.153073.log.gz 2024-09-14T22:46:46.439 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45956.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.111882.log 2024-09-14T22:46:46.439 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45956.log.gz 2024-09-14T22:46:46.440 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62153.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62153.log.gz 2024-09-14T22:46:46.440 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.62511.log 2024-09-14T22:46:46.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.111882.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.45216.log 2024-09-14T22:46:46.441 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.111882.log.gz 2024-09-14T22:46:46.441 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.62511.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.62511.log.gz 2024-09-14T22:46:46.442 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.112701.log 2024-09-14T22:46:46.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.45216.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.118223.log 2024-09-14T22:46:46.442 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.45216.log.gz 2024-09-14T22:46:46.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.112701.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.112701.log.gz 2024-09-14T22:46:46.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.50285.log 2024-09-14T22:46:46.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.118223.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.mirror.118223.log.gz 2024-09-14T22:46:46.444 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132501.log 2024-09-14T22:46:46.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.50285.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.50285.log.gz 2024-09-14T22:46:46.444 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.153432.log 2024-09-14T22:46:46.445 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132501.log: gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.142485.log 2024-09-14T22:46:46.445 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132501.log.gz 2024-09-14T22:46:46.446 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.153432.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.102957.log 2024-09-14T22:46:46.446 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.153432.log.gz 2024-09-14T22:46:46.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.142485.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.142485.log.gz 2024-09-14T22:46:46.447 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.135093.log 2024-09-14T22:46:46.447 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.102957.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53416.log 2024-09-14T22:46:46.447 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.102957.log.gz 2024-09-14T22:46:46.448 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.135093.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.135093.log.gz 2024-09-14T22:46:46.448 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.145893.log 2024-09-14T22:46:46.449 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53416.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.137343.log 2024-09-14T22:46:46.449 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53416.log.gz 2024-09-14T22:46:46.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.145893.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.145893.log.gz 2024-09-14T22:46:46.450 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.65240.log 2024-09-14T22:46:46.450 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.137343.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.137343.log.gz 2024-09-14T22:46:46.451 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.151321.log 2024-09-14T22:46:46.451 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.65240.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.65240.log.gz 2024-09-14T22:46:46.452 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.150312.log 2024-09-14T22:46:46.452 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.151321.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.151321.log.gz 2024-09-14T22:46:46.452 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.45829.log 2024-09-14T22:46:46.453 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.150312.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.150312.log.gz 2024-09-14T22:46:46.453 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.70347.log 2024-09-14T22:46:46.454 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.45829.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.45829.log.gz 2024-09-14T22:46:46.454 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.47829.log 2024-09-14T22:46:46.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.70347.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.70347.log.gz 2024-09-14T22:46:46.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.84643.log 2024-09-14T22:46:46.456 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.47829.log: gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.110645.log 2024-09-14T22:46:46.456 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.47829.log.gz 2024-09-14T22:46:46.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84643.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84643.log.gz 2024-09-14T22:46:46.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.132649.log 2024-09-14T22:46:46.457 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.110645.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.110645.log.gz 2024-09-14T22:46:46.457 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.107648.log 2024-09-14T22:46:46.458 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.132649.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.132649.log.gz 2024-09-14T22:46:46.458 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.mirror.59092.log 2024-09-14T22:46:46.459 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.107648.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.107648.log.gz 2024-09-14T22:46:46.459 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.66458.log 2024-09-14T22:46:46.460 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.mirror.59092.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.mirror.59092.log.gz 2024-09-14T22:46:46.460 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.150245.log 2024-09-14T22:46:46.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.66458.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.66458.log.gz 2024-09-14T22:46:46.461 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68182.log 2024-09-14T22:46:46.461 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.150245.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.150245.log.gz 2024-09-14T22:46:46.462 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.113249.log 2024-09-14T22:46:46.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68182.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.68182.log.gz 2024-09-14T22:46:46.463 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.53919.log 2024-09-14T22:46:46.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.113249.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.113249.log.gz 2024-09-14T22:46:46.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.68561.log 2024-09-14T22:46:46.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.53919.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.53919.log.gz 2024-09-14T22:46:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster2-client.admin.92919.log 2024-09-14T22:46:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.68561.log: 0.0%gzip -- replaced with /var/log/ceph/cluster1-client.admin.68561.log.gz -5 --verbose 2024-09-14T22:46:46.465 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/cluster1-client.mirror.84768.log 2024-09-14T22:46:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster2-client.admin.92919.log: 0.0% -- replaced with /var/log/ceph/cluster2-client.admin.92919.log.gz 2024-09-14T22:46:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.admin.44081.log 2024-09-14T22:46:46.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.84768.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.84768.log.gz 2024-09-14T22:46:46.467 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.41447.log 2024-09-14T22:46:46.468 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/cluster2-client.mirror.0.34689.log.gz 2024-09-14T22:46:46.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.admin.44081.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.admin.44081.log.gz 2024-09-14T22:46:46.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cluster1-client.mirror.141936.log 2024-09-14T22:46:46.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.41447.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.41447.log.gz 2024-09-14T22:46:46.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cluster1-client.mirror.141936.log: 0.0% -- replaced with /var/log/ceph/cluster1-client.mirror.141936.log.gz 2024-09-14T22:46:46.545 INFO:teuthology.orchestra.run.smithi063.stderr: 91.6% -- replaced with /var/log/ceph/cluster1-mgr.x.log.gz 2024-09-14T22:46:53.231 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/cluster2-mgr.x.log.gz 2024-09-14T22:46:58.635 INFO:teuthology.orchestra.run.smithi063.stderr: 90.4% -- replaced with /var/log/ceph/cluster1-mon.a.log.gz 2024-09-14T22:47:21.171 INFO:teuthology.orchestra.run.smithi169.stderr: 90.3% -- replaced with /var/log/ceph/cluster2-mon.a.log.gz 2024-09-14T22:51:30.544 INFO:teuthology.orchestra.run.smithi169.stderr: 94.3% -- replaced with /var/log/ceph/cluster2-osd.1.log.gz 2024-09-14T22:51:40.071 INFO:teuthology.orchestra.run.smithi169.stderr: 94.3% -- replaced with /var/log/ceph/cluster2-osd.2.log.gz 2024-09-14T22:52:04.089 INFO:teuthology.orchestra.run.smithi169.stderr: 94.3% -- replaced with /var/log/ceph/cluster2-osd.0.log.gz 2024-09-14T22:52:04.091 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-14T22:52:04.091 INFO:teuthology.orchestra.run.smithi169.stderr:real 5m21.920s 2024-09-14T22:52:04.091 INFO:teuthology.orchestra.run.smithi169.stderr:user 2m8.129s 2024-09-14T22:52:04.092 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m29.486s 2024-09-14T22:53:11.446 INFO:teuthology.orchestra.run.smithi063.stderr: 94.2% -- replaced with /var/log/ceph/cluster1-osd.1.log.gz 2024-09-14T22:53:24.035 INFO:teuthology.orchestra.run.smithi063.stderr: 94.2% -- replaced with /var/log/ceph/cluster1-osd.2.log.gz 2024-09-14T22:54:15.246 INFO:teuthology.orchestra.run.smithi063.stderr: 94.2% -- replaced with /var/log/ceph/cluster1-osd.0.log.gz 2024-09-14T22:54:15.293 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-14T22:54:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:real 7m33.110s 2024-09-14T22:54:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:user 5m0.033s 2024-09-14T22:54:15.293 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m43.761s 2024-09-14T22:54:15.294 INFO:tasks.ceph:Archiving logs... 2024-09-14T22:54:15.294 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi063/log 2024-09-14T22:54:15.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T22:54:54.549 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi169/log 2024-09-14T22:54:54.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T22:55:15.936 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T22:55:15.973 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T22:55:15.974 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T22:55:15.978 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T22:55:16.104 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T22:55:16.114 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T22:55:16.114 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T22:55:16.118 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T22:55:16.150 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-14T22:55:16.155 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 8 377 203 +818us[ +836us] +/- 45ms 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 81 +817us[ +817us] +/- 62ms 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -2205us[-2205us] +/- 71ms 2024-09-14T22:55:16.199 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T22:55:16.284 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T22:55:16.284 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-14T22:55:16.284 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 7 377 8 +733us[ +726us] +/- 48ms 2024-09-14T22:55:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 16 +698us[ +691us] +/- 63ms 2024-09-14T22:55:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -2335us[-2342us] +/- 71ms 2024-09-14T22:55:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T22:55:16.286 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T22:55:16.296 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T22:55:16.296 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T22:55:16.305 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T22:55:16.470 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T22:55:16.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T22:55:16.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T22:55:16.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T22:55:16.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T22:55:16.774 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T22:55:17.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T22:55:17.152 INFO:teuthology.task.internal:Duration was 6101.094916 seconds 2024-09-14T22:55:17.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T22:55:17.197 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T22:55:17.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T22:55:17.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T22:55:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T22:55:17.388 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T22:55:17.860 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T22:55:17.860 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-14T22:55:17.860 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T22:55:17.918 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-14T22:55:17.919 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T22:55:17.967 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T22:55:17.968 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T22:55:17.972 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T22:55:18.031 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T22:55:18.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T22:55:18.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T22:55:18.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T22:55:18.283 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T22:55:18.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T22:55:18.359 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T22:55:18.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T22:55:18.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T22:55:18.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T22:55:18.528 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-14T22:55:18.535 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-14T22:55:18.565 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T22:55:18.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T22:55:18.599 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T22:55:18.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T22:55:18.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T22:55:18.643 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T22:55:18.644 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi063 2024-09-14T22:55:18.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T22:55:18.708 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-14_20:48:16-krbd-main-testing-default-smithi/7904598/remote/smithi169 2024-09-14T22:55:18.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T22:55:18.773 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T22:55:18.773 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T22:55:18.778 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T22:55:18.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T22:55:18.824 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T22:55:18.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T22:55:18.834 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T22:55:18.834 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T22:55:18.853 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T22:55:18.884 INFO:teuthology.orchestra.run.smithi063.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 22:55 /home/ubuntu/cephtest 2024-09-14T22:55:18.887 INFO:teuthology.orchestra.run.smithi169.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 22:55 /home/ubuntu/cephtest 2024-09-14T22:55:18.889 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T22:55:18.901 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T22:55:18.931 INFO:teuthology.run:Summary data: cluster1.mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a cluster2.mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{legacy} tasks/compare-mirror-images} duration: 6101.094916343689 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T22:55:18.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T22:55:19.006 INFO:teuthology.run:pass